Information processing method and apparatus

ABSTRACT

The state of a label at an optional time point, such as a past time point, can be recognized, while the label can be regenerated even when the label has been deleted. When a label on which can be pasted an object, such as text, picture or sound, is acted upon (yes at step S 141 ) the difference of the label information is computed (step S 142 ) and the computed difference information is stored (steps S 144 , S 145 ). The label state is then regenerated based on the time information stored in association with the label and the difference information. Also, time is displayed, plural time intervals are displayed (step S 201 ), a desired one of the plural time intervals is selected (step S 202 ) and time display is controlled responsive to the selected time intervals (steps S 203  to S 206 ), to facilitate retrieval of the information corresponding to the specified time. In addition, a label handling at least the time concept is processed (step S 231 ) and the time axis in displaying the label is controlled (step S 233 ) based on an operating signal associated with rotational actuation from a jog dial (step S 232 ).

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a divisional of U.S. application Ser. No.10/876,702, filed on Jun. 28, 2005, which is a divisional of U.S.application Ser. No. 09/575,104, filed on May 19, 2000, now U.S. Pat.No. 7,100,105, the entire contents of each of which are herebyincorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

This invention relates to an information processing method andapparatus, and a medium. More particularly, it relates to an informationprocessing method and apparatus, and a medium in which pre-setprocessing can be executed on a label bonded as a tag sheet on a desktop screen of a personal computer.

2. Description of Related Art

It has hitherto been a frequent practice to attach a tag sheet as aneye-mark for paper documents, to write a memo on the tag sheet and pasteit somewhere for use as reminder. An application program forregenerating a similar thing on a desktop screen of a personal computerhas been proposed by the present Assignee. In actuality, a personalcomputer on which is pre-installed this application program is on sale.In the following description, a tag sheet displayed on the desktopscreen is called a label and an application program for displaying alabel on the desktop is called a label software. In this label. Not onlythe test, such as letters, but also speech or pictures, can be handledby exploiting the fact that the label software is an application programon a personal computer. Meanwhile, a paper tag sheet cannot handle thespeech or pictures, such as moving pictures.

FIG. 1 shows an exemplary representation of a label on the desktopscreen. In this figure, not only the text, such as letters, but alsoletters or pictures, can be pasted on the label L. Meanwhile, the labelL in a lower portion of FIG. 1 shows the state in which a picture hasbeen pasteed in position. If the speech etc is pasted on the label L,and a playback button PB, for example, is clicked, such as with a mouse,the speech can be reproduced. On the other hand, if a stop button B isclicked, such as with a mouse, the speech reproduction can be halted.

With the application program (label software) for pasting the label onthe desktop, the operation of preparing, moving and deleting the labelis possible. Moreover, changes in the text or pictures or speechrecording can be performed on the label.

However, in the label software, in which, if the label has beencorrected, only the latest information following the correction ispreserved, so that it is not possible to identify what was the state ofthe label e.g., at an optional past time point. Moreover, if the labelhas been deleted, the data converning the label is completely erased, sothat the label cannot be seen again, for example, the label cannot bere-displayed on the desktop.

SUMMARY OF THE INVENTION

It is therefore an object of the present invention to provide aninformation processing method and apparatus, and a medium, whereby thestate of a label at an optional past time point can be identified andwhereby, if the label is deleted, the label can be regenerated.

If the date and time indicated on a date/time indicator in a pre-setwindow on the desktop are to be changed, the routine practice is toindicate one of the year, month, day, hour and the minute etc of thedate/time indicator and to change its figure. For example, if, with thedisplay “1999: 05: 21: 12: 00: 00” (May 21, 1999, 12 o'clock, 0 min 0sec), the month figure is to be changed, the cursor is set to the monthindication (“05”) to activate it and an entry is made directly from thekeyboard. Alternatively, the up/down key on the keyboard is acted uponto change the figure, or a pre-set button for time up/down indication isclicked with a mouse. This time/date indication is highly cumbersome.

It is therefore another object of the present invention to provide aninformation processing method and apparatus and a medium in which, whenthe personal computer is to deal with the concept of time, timedesignation can be simplified and facilitated, and in which theinformation corresponding to the designated time can be retrievedeasily.

In one aspect, the present invention provides an information processingapparatus including storage means for memorizing a pre-set processingunit, in which to paste the object information of different attributes,in association with the time information, and regenerating means forregenerating the state of the pre-set processing unit associated with adesired date and time, based on the time information.

In another aspect, the present invention provides an informationprocessing apparatus including memorizing a pre-set processing unit, inwhich to paste the object information of different attributes, inassociation with the time information, and regenerating the state of thepre-set processing unit associated with a desired date and time, basedon the time information.

In yet another aspect, the present invention provides a medium whichpermits an information processing apparatus to execute a programincluding a step of memorizing a pre-set processing unit, in which topaste the object information of different attributes, in associationwith the time information, and a step of regenerating the state of thepre-set processing unit associated with a desired date and time, basedon the time information.

With the information processing method and apparatus and the medium,according to the present invention, the pre-set processing unit in whichto paste the object information of different attributes and the timeinformation are stored in association with each other, and the state ofthe pre-set processing unit associated with the desired date and time isregenerated based on the time information, whereby the label state at anoptional time point, such as a past time point, can be recognized.Moreover, if the label is deleted, it can be regenerated.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows an example of a tag sheet (label) pasted on the desktop.

FIG. 2 is a perspective view showing a notebook type personal computerembodying the present invention.

FIG. 3 is a plan view showing a main body portion of the notebook typepersonal computer shown in FIG. 2.

FIG. 4 is an enlarged view showing a jog dial essential to the presentinvention.

FIG. 5 is a side view of the jog dial side of the main body portion.

FIG. 6 is a perspective view of the jog dial.

FIG. 7 is a perspective view showing a contact mounting substrateessential to the jog dial shown in FIG. 6.

FIG. 8 is a front cross-sectional view of the jog dial.

FIG. 9 is a side cross-sectional view of the jog dial.

FIG. 10 is a side view of an equipment for illustrating the mountingstate of the jog dial thereon.

FIG. 11 is a top plan view showing a rotary encoder constituting the jogdial.

FIG. 12 is a top plan view showing push switch portion of the jog dial.

FIG. 13 is an electrical circuit diagram of the notebook type personalcomputer shown in perspective in FIG. 2.

FIG. 14 shows a hardware structure in which an embedded controller ismonitoring the state of the rotary encoder portion of the jog dialthrough a rotation detection unit.

FIG. 15 is a flowchart showing the state in which the embeddedcontroller has executed the jog dial state monitor program.

FIG. 16 is a timing chart for illustrating the operation of the rotationdetection unit shown in FIG. 14.

FIG. 17 is a flowchart for illustrating the jog dial state monitorprogram executed by CPU of the notebook type personal computer afterturning on of a power source switch.

FIG. 18 illustrates an exemplary display of jog dial menu.

FIG. 19 illustrates another exemplary display of jog dial menu.

FIG. 20 illustrates still another exemplary display of jog dial menu.

FIG. 21 illustrates an exemplary display of sub-menu.

FIG. 22 illustrates another exemplary display of sub-menu.

FIG. 23 is a flowchart for illustrating a notification processing whicha jog-dial related application performs for the jog dial state monitorprogram executed by a CPU.

FIG. 24 is a flowchart for illustrating an event operation by a jog-dialrelated application or a jog-dial non-related application.

FIG. 25 shows an exemplary window display of a first specified exampleof the jog-dial related application.

FIG. 26 shows the state of registering an application in an applicationlist started especially from the launcher function in setting a jogdial.

FIG. 27 shows the relationship between data of the project, label andthe object handled by the label software of the present embodiment.

FIG. 28 shows an example of a desktop picture during the normal modeoperation.

FIG. 29 shows an illustrative structure of a desktop picture in thepresent mode.

FIG. 30 shows an illustrative structure of a desktop picture in the pastmode.

FIG. 31 shows an illustrative structure of a desktop picture in thefuture mode.

FIG. 32 shows an example of a window picture of a label of the presentembodiment.

FIG. 33 illustrates a tool chip showing the play time (sound recordingtime) relevant to the play and pause buttons.

FIG. 34 illustrates a tool chip showing the link contents relevant tothe link button (file path of a link destination or URL).

FIG. 35 illustrates examples of an alarm icon and repetitive icon.

FIG. 36 shows a bar-state time view console window.

FIG. 37 shows a floating state time view console window

FIG. 38 is an enlarged view showing only the vicinity if a rotationanimation portion on the left end of the bar-state time view consolewindow.

FIG. 39 shows an exemplary display of an operating menu in the “displayall” state of the labels during the normal mode.

FIG. 40 shows an exemplary display of an operating menu in the “hideall” state of the labels during the normal mode.

FIG. 41 shows an exemplary display of an operating menu during the pastmode.

FIG. 42 shows an exemplary display of an operating menu during thefuture mode.

FIG. 43 illustrates different icons for the present, past and futuremodes.

FIG. 44 illustrates an exemplary display of a new project preparationdialog.

FIG. 45 shows an exemplary display of a time setting dialog at the timeof importing for showing the project information.

FIG. 46 shows an exemplary display of a project import dialog.

FIG. 47 shows an exemplary display of a dialog specifying an importmethod.

FIG. 48 shows an exemplary display of a project export dialog.

FIG. 49 shows an exemplary display of a project property dialog.

FIG. 50 shows an exemplary display of a label property dialog.

FIG. 51 shows an exemplary display of a text editing dialog.

FIG. 52 illustrates the manner in which a tool chip indicating therecording time and the maximum recording time on recording selection andthe play button are changed to a recording button.

FIG. 53 shows an exemplary display of a link editing dialog.

FIG. 54 shows an exemplary display of a clipboard object selectiondialog.

FIG. 55 illustrates the definition of a text margin and a picturemargin.

FIG. 56 shows an exemplary display of a dialog when the default labellayout is selected in the label setting dialog.

FIG. 57 illustrates the label layout operation by dragging with a samplebeing displayed.

FIG. 58 shows an exemplary display of a label during customary layoutexecution.

FIG. 59 shows an exemplary display of an alarm dialog.

FIG. 60 shows an exemplary display of a current label deletion diagram.

FIG. 61 shows an exemplary display of a future label deletion diagram.

FIG. 62 shows an exemplary display of an alarm dialog in link pasting.

FIG. 63 shows an exemplary display of a jog dial guide during normalmode.

FIG. 64 shows an exemplary display of a jog dial guide during time viewmode.

FIG. 65 shows an exemplary display of a dialog on selection of labelsetting in a label setting dialog.

FIG. 66 shows an exemplary display of a dialog on selection of recordingsetting in a label setting dialog.

FIG. 67 shows an exemplary display of dialog on selection of picturesetting in a label setting dialog.

FIG. 68 shows an exemplary display of dialog on selection of environmentsetting in a label setting dialog.

FIG. 69 is a flowchart showing the overall processing flow in case thelabel state at an optional past time point is regenerated, anappointment is made for an operation for a future label, the operationfor a future label is regenerated and alarm processing is realized onthe CPU.

FIG. 70 is a flowchart showing details of the recording processing atstep S132 of the flowchart of FIG. 69.

FIG. 71 is a flowchart showing details of the alarm processing at stepS133 of the flowchart of FIG. 69.

FIG. 72 is a flowchart showing details of the label updating processingat step S134 of the flowchart of FIG. 69.

FIG. 73 is a flowchart showing the overall processing in case theprocessing of indirectly pasting the entire information on a label by alink is to be performed by the CPU.

FIG. 74 is a flowchart showing details of the link editing processing atstep S173 of the flowchart of FIG. 73.

FIG. 75 is a flowchart showing details of the link executing processingat step S175 of the flowchart of FIG. 73.

FIG. 76 is a flowchart showing the overall processing in case theprocessing for enabling time shift to an optional time of thepresent/past/future is to be realized on a CPU.

FIG. 77 is a flowchart showing details of the movement unit changingprocessing at step S203 of the flowchart of FIG. 76.

FIG. 78 is a flowchart showing details of the time movement processingat step S205 of the flowchart of FIG. 76.

FIG. 79 is a flowchart showing the overall processing in case theprocessing for enabling time shift to an optional time of thepresent/past/future is to be realized by a jog dial operation on a CPU.

FIG. 80 is a flowchart showing details of the information browsingprocessing at step S233 of the flowchart of FIG. 79.

FIG. 81 is a flowchart showing details of the movement unit changingprocessing at step S244 of the flowchart of FIG. 80.

FIG. 82 is a flowchart showing details of the time movement processingat step S246 of the flowchart of FIG. 80.

FIG. 83 is a flowchart showing the overall processing in case theprocessing for using the jog dial operation as a user interface for timemovement is to be implemented by a CPU.

FIG. 84 is a flowchart showing details of the information browsingprocessing at step S273 of the flowchart of FIG. 83.

FIG. 85 is a flowchart showing the overall processing in case thefunction of presenting the label state to the user by changing thefringe color of the correction inhibiting label is to be implemented bya CPU.

FIG. 86 is a flowchart showing details of the information browsingprocessing at step S293 of the flowchart of FIG. 85.

FIG. 87 is a flowchart showing details of the label editable stateupdating processing at step S307 of the flowchart of FIG. 86.

FIG. 88 is a flowchart showing the overall processing in case thefunction of instantly reverting to the current time by the presentbutton of the time view console is to be implemented by a CPU.

FIG. 89 is a flowchart showing details of the information browsingprocessing at step S323 of the flowchart of FIG. 88.

FIG. 90 is a flowchart showing the overall processing in case thefunction of making the task tray icon design to differ in the present,past and future modes and in the all hide state in the present mode isto be implemented by a CPU.

FIG. 91 is a flowchart showing details of the information browsingprocessing at step S346 of the flowchart of FIG. 90.

FIG. 92 is a flowchart showing details of the task tray icon updatingprocessing at step S356 of the flowchart of FIG. 91.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Referring to the drawings, preferred embodiments of the presentinvention will be explained in detail.

FIGS. 2 to 5 illustrate the appearance of a notebook personal computer 1as an example of application of the apparatus and the method forprocessing the information according to the present invention. Thisnotebook personal computer 1 is basically constituted by a main bodyportion 2 and a display portion 3 that can be opened/closed with respectto this main body portion 2. FIG. 2 shows the appearance of the notebookpersonal computer 1 with the display portion 3 being opened relative tothe main body portion 2. FIG. 3 shows the plan view of the main bodyportion 2 and FIG. 4 shows an enlarged view the vicinity of a jog dial4, as later explained, constituting the essential portions of thepresent invention. FIG. 5 is a side view of the side of the jog dial 4of the main body portion 2.

On the upper surface of the main body portion 2, there are provided akeyboard 5, acted upon when various letters or symbols are to beinputted, a touch pad 6 as a pointing device acted upon for causingmouse cursor movement, and a power source switch 8.

On the front side of the display portion 3, there is provided an LCD(liquid crystal display) 7 for demonstrating a picture. On the rightupper side of the display portion 3, there are provided a power sourcelamp PL, a battery lamp BL, a message lamp ML and other LED lamps.

Referring to the setting positions of the jog dial 4 in detail, the jog4 is built in a space between keys A and B (rightmost key) on thekeyboard 5 on the main body portion 2, on substantially the same levelas the keys A and B.

The jog dial 4 executes pre-set processing responsive to the rotatingactuation as indicated by arrow a in FIG. 4, while executing pre-setprocessing responsive to the movement actuation as indicated by arrow bin FIG. 4. The pre-set processing executed by the jog dial 4 will beexplained subsequently.

The structure of this jog dial 4 is first explained.

The jog dial 4 includes a rotary encoding unit 12 and a push switch unit13 on a contact mounting substrate 11. The rotary encoding unit 12 isadapted for being moved in the horizontal direction within a pre-setrange, whilst the push switch unit 13 is fixed.

Referring to FIG. 7, the contact mounting substrate 11 includes acontact plate 19 comprising a molded resin member in the form of a flatplate having recesses 15,17 and a terminal 18. The recess 15 has a guiderail 14 for movement of the rotary encoding unit 12, while the recess 17has a retention wall section 16 for immobilizing the push switch unit13. The terminal 18 serves for transmitting electrical signals of therotary encoding unit 12 to outside.

Referring to FIGS. 8 and 9, the rotary encoding unit 12 includes abox-shaped casing 20 of molded resin fitted in the recess 15 of thecontact mounting substrate 11 and retained for movement within a pre-setrange in the horizontal direction as indicated by arrow H1 in FIGS. 6and 9, and elastic contact legs 21, 22 protruded upwards and downwardsfrom an elastic contact member 45 mounted by insert molding on thebottom surface of the box-shaped casing 20. The rotary encoding unit 12also includes a rotary member 25 of synthetic resin retained forrotational movement by a columnar shaft 23 formed integrally with themid portion of the box-shaped casing 20 and which includes a disc-shapedradial contact plate 24 on the lower surface of which is elasticallycontacted the elastic contact leg 21, and a peripheral actuating typecircular knob 27 mounted by a screw 26 over the rotary member 25 forrotationally actuating the rotary member 25. With the rotary encodingunit 12, the lateral surface of the box-shaped casing 20 is pushed inthe horizontal direction by a torsion coil spring 29 positioned by apin-shaped projection 28 on the contact mounting substrate 11 (see FIGS.7 and 11) so that the rotary encoding unit 12 is biased to a positionspaced in a normal state apart from the push switch unit 13. Moreover,the elastic contact leg 22, protruded downwards from the bottom surfaceof the box-shaped casing 20, is in elastic contact with the contactplate 19 of the contact mounting substrate 11.

The push switch unit 13 is secured by fitting in the recess 17 in thecontact mounting substrate 11 so that an actuating button 30 faces therotary encoding unit 12, with the rear end of the button compressingagainst the retention wall section 16. 19, as shown in FIGS. 6 and 7.

A driving projection 31 formed integrally with the box-shaped casing 20of the rotary encoding unit 12 compresses against the distal end of theactuating button 30 of the push switch unit 13, as shown in FIG. 9. Theforegoing is the structure of the jog dial. When the jog dial is to bemounted on an electronic equipment, legs 11A, 11B on the lower surfaceof the contact mounting substrate 11, the connection terminal 18 of therotary encoding unit 12 and a connection terminal 32 of the push switchunit 13 are introduced and soldered in mounting openings 33A, 34B, 35and 36 of a printed circuit board 33 of the electronic equipment, withthe jog dial being mounted in position with the end of the peripheralactuating knob 27 of the rotary encoding unit 12 opposite to the pushswitch unit 13 protruding from a gap of an exterior casing 37 of theelectronic equipment.

The operation of the jog dial is explained. Referring first to FIGS. 10and 11, a protruding portion 27A from the exterior casing 37 of theperipheral actuating knob 27 mounted on the upper end of the rotaryencoding unit 12 is acted upon by a tangential force so as to perform arotational movement, whereby the rotary member 25 is rotated about thecenter columnar shaft 23 of the box-shaped casing 20 as the center ofrotation. The upper elastic contact leg 21 then slides in elasticcontact with the radial contact plate 24 provided on its lower surface.This sliding contact portion generates pulse signals timed to therotational actuation of the peripheral actuating knob 27.

The generated pulse signals are transmitted from the upper elasticcontact leg 21 to the lower elastic contact leg 22 and thence to thecontact plate 19 on the contact mounting substrate 11 to which iselastically contacted the elastic contact leg 22. The pulse signals arethen transmitted to the circuit of the printed circuit board 33 of theelectronic equipment through the terminal 18 for external connection.

The protruding portion 27A of the peripheral actuating knob 27 then isacted upon with a thrusting force in the horizontal directioninterconnecting the center of the knob and the push switch unit 13, asindicated by arrow H2, against the biasing force of the torsion coilspring 29 provided on the contact mounting substrate 11, as shown inFIG. 12, to cause movement of the entire rotary encoding unit 12 in thehorizontal direction along the guide rail unit 14 of the contactmounting substrate 11 to push the actuating button 30 with theprojection 31 provided on the box-shaped casing 20. The resulting signalis transmitted to the circuitry of the printed circuit board 33 of theelectronic equipment through a connection terminal 21 shown in FIG. 10.

If the thrusting force applied to the peripheral actuating knob 27 isremoved, the rotary encoding unit 12 is pushed back under the elasticrecoiling force of the torsion coil spring 29 of the contact mountingsubstrate 11 to resume the state shown in FIG. 11.

In the above-described structure, the elastic contact leg 22, protrudeddownwards from the bottom surface of the box-shaped casing 20 of therotary encoding unit 12, elastically contacts the contact plate 19 ofthe contact mounting substrate 11, as means for transmitting theelectrical signals of the rotary encoding unit 12 to the contact plate18 of the contact mounting substrate 11. Alternatively, the elasticcontact leg may be protruded from the contact mounting substrate 11 soas to be elastically contacted with the contact plate on the bottomsurface of the box-shaped casing 20. The foregoing is the explanation ofthe structure and the operation of the jog dial 4 provided on the rightlateral surface of the main body portion 2.

Of course, the jog dial 4 may be provided on the left lateral surface ofthe main body portion 2. The jog dial 4 may also be arranged centrallyof the front surface of the main body portion 2 so that the jog dial 4can be actuated with a thumb finger as the touch pad 6 is actuated withthe index finger. The jog dial may also be arranged on the left or rightsurface of the display portion 3 carrying the LCD 7, or along the leftor right edge of the touch pad 6. The jog dial may also be arrangedlongitudinally between left and right buttons or longitudinally betweenG and H keys of the keyboard unit 5. The jog dial may also be arrangedin an angled direction to permit facilitated actuation with respectivefingers without distinction as to longitudinal or transverse directions.The jog dial 4 may also be arranged at a position permitting actuationwith a thumb finger on a lateral surface of the mouse as the pointingdevice. An exemplary electrical structure of the notebook personalcomputer 1 is explained with reference to FIG. 2. a central processingunit (CPU) 11 comprises e.g., Pentium (trademark) of INTEL INC., and isconnected to a host bus 52. To the host bus 52 is connected a northbridge 53 which in turn is connected to a PCI bus 56. The north bridge53 comprises e.g., 400BX manufactured by INTEL. INC., and is adapted forcontrolling the CPU 51 or the main memory 54 with its periphery. Thenorth bridge 53 and the south bridge 58, as later explained, constitutea so-called chip set.

The north bridge 53 also is connected to a main memory 54 and to a cachememory 55 adapted for caching data used by the CPU 51. Although notshown, a first-order cache memory is enclosed in the CPU 51.

The main memory 54 comprises e.g., a DRAM (dynamic read-only memory)adapted for storing the programs executed by the CPU 51 or datanecessary for the operation by the CPU 51. Specifically, at the tunepoint of end of startup, an E-mail program 54A, an auto-pilot program54B, a jog dial state monitor program 54C, a jog dial driver 54D, anoperating program (OS) 54E and other application programs 54F1 to 54Fnare transferred from an HDD 70 for storage in the main memory 54.

The E-mail program 54A is a program for exchanging communication textover the network with communication networks, such as telephone network76, over a modem 75, which will be explained subsequently. The E-mailprogram 54A also has the function of acquiring oncoming mails as aspecified function. This oncoming mail acquiring function inquireswhether or not a mail addressed to the user has arrived at the mail box79 to a mail server 78 of a provider 77 and acquired a mail addressed tothe user, if any.

The auto-pilot program 54B sequentially starts pre-set plural processingoperations or programs to perform the processing.

The OS (basic program software) 54E, typified by the Windows 95 orWindows 98 (trademarks) by MICROSOFT INC. or MAC OS (trademark) by APPLECOMPUTER INC., controls the basic operations of the computers.

The jog dial state monitor program 54C receives the notice from therespective application as to whether or not the applications are adaptedfor coping with the jog dial. If the notice is affirmative, the jog dialstate monitor program 54C operates to demonstrate what can be done byactuating the jog dial 4. The jog dial state monitor program 54C isusually in a state of awaiting an event of the jog dial 4 and owns alist for receiving notices from the application. The jog dial statemonitor program 54C is responsive to the actuation of the jog dial statemonitor program 54C to execute various functions.

A video controller 57 is connected to a PCI bus 56 and is adapted forcontrolling the display on the LCD 7 on the display portion 3.

To the PCI bus 56 is connected a sound controller 64 adapted forcapturing an input from a microphone 66 or supplying audio signals to aspeaker 65. To the PCI bus 56 is also connected a modem 75 which can beconnected over a public telephone network 76 or an Internet serviceprovider 77 to a communication network 80, such as Internet, or to amail server 78.

To the PCI bus 56 is also connected the south bridge 58 comprising e.g.,PIIX4E of INTEL INC. and which is adapted for controlling various I/O(input/output). That is, the south bridge 58 comprises an IDE(Integrated Drive Electronics) controller/configuration register 59,timer circuit 60 and an IDE interface 61, and is adapted for controllinga device connected to the IDE bus 62 or a device connected via anISA/EIO (Industry Standard Architecture/Extended Input Output) bus 63 oran embedded controller 68.

The IDE controller/configuration register 59 is made up of two IDEcontrollers, namely a so-called primary IDE controller and a secondaryIDE controller, and a configuration register. These IDE controllers arenot shown for simplicity of the drawings.

The primary IDE controller is connected over the IDE bus 62 to aconnector, not shown. An HDD 67 is connected to the connector. When baydevices, as so-called IDE devices, such as CD-ROM drive, second HDD orFDD, not shown, are loaded over other IDE buses, the secondary IDEcontroller is electrically connected to connectors of the loaded baydevices.

Meanwhile, the HDD 67 has stored therein plural application programs67F1 to 67Fn, in addition to the autopilot program 67B, auto-pilotprogram 54B, jog dial state monitor program 54C, jog dial driver 54D andthe OS (basic program software) 67E. The above-mentioned respectiveprograms 67A, 67B, 67C, 67D, 67E and 67F1 to Fn in the HDD 67 aresequentially transferred to the RAM 54 for storage therein during thestartup (bootstrap) process.

To the ISA/EIO bus 63 is also connected an embedded controller 68 whichcomprises a micro-controller and which is used as an I/O controller.That is, the embedded controller 68 is constructed by an interconnectionof an I/O interface 69, a ROM 70, a RAM 71 and a CPU 72.

In the ROM 70, there are stored from the outset a LED control program70A, a touchpad input monitor program 70B, a key input monitor program70C, a wakeup program 70D and a jog dial state monitor program 70E.

The LED control program 70A is a program for controlling the lighting ofa lamp, such as a power source lamp PL, a battery lamp BL, a messagelamp ML, if necessary, or other LEDs. The touchpad input monitor program70B is a program for monitoring the user input from the touch pad 6. Thekey input monitor program 70C is a program for monitoring the input fromthe keyboard 5 or other key switches. The wakeup program 70D is aprogram for checking, based on current time data supplied from a timercircuit 60 within the south bridge 58, whether or not the time is thepre-set time and, should the time be the pre-set time, various chippower sources are managed for starting pre-set processing operations orprograms.

The jog dial state monitor program 70E is a program for perpetuallymonitoring whether the rotary encoding unit 12 of the jog dial 4 hasbeen rotated or pressed. The jog dial state monitor program 70E will beexplained in detail subsequently.

In the ROM 70 is further written BIOS (basic input/output system) 70F.The BIOS is a basic input/output system, that is a software programcontrolling data exchange (input/output) between the OS or theapplication software and peripherals, such as display, keyboard or HDD.

The RAM 71 includes registers for a touchpad input status, a key inputstatus and for time setting, and a jog dial status monitor I/O register,as registers 71A to 71F. For example, an LED control register 71Acontrols the lighting of a message lamp ML displaying the instantaneousrising state of the E-mail on thrusting the jog dial 4 as explainedlater. The key input status register 71C stores an actuating key flagwhen the jog dial 4 is pushed for one-touch operation as laterexplained. The time setting register 71D is able to set optional time.

To the embedded controller 68 are connected the jog dial 4, touch pad 6and the keyboard 5 through a connector, not shown, to output signalsassociated with the operations of the jog dial 4, touch pad 6 and thekeyboard 4 to the ISA/EIO bus 63. To the embedded controller 68 are alsoconnected the power source lamp PL, battery lamp BL, message lamp ML andother LED lamps.

To the embedded controller 68 is also connected a power source controlcircuit 73 in turn connected to an enclosed battery 74 or an AC powersource. The power source control circuit 73 furnishes the necessarypower to each block, while managing control to charge secondarybatteries of the peripherals. The embedded controller 68 also monitors apower source switch 8 operated on turning the power source on or off.

The embedded controller 68 is able to execute the above-mentionedprograms 70A to 70E by an internal power source at all times even whenthe power source 8 is turned off. That is, the above-mentioned programsare running at all times even if no windows are opened on the LCD 7 ofthe display portion 3. That is, the embedded controller 68 executes thejog dial state monitor program 70E at all times even when the powersource switch 8 is off or the OS54 is not started on the CPU 51. Inparticular, the embedded controller 68 furnishes the function of aprogrammable power key (PPK) to the notebook personal computer 1 even ifthe computer is not provided with a dedicated key, such that the desiredsoftware or the script file can be started simply when the user pushesthe jog dial 4 in the power saving mode or in a power down state.

Referring to FIGS. 14 to 16, the operation of the e48 on execution ofthe jog dial state monitor program 70E is explained. FIG. 14 shows thehardware configuration for monitoring of the state of the rotaryencoding unit 12 of the jog dial 4 by the embedded controller 68 througha rotation sensor 85. FIG. 15 shows a flowchart for illustrating theexecution of the jog dial state monitor program 70E by the embeddedcontroller 68. FIG. 16 shows a timing chart for illustrating theoperation of the rotation sensor 85 shown in FIG. 14.

When the rotary encoding unit 12 of the jog dial 4 is rotated towardsleft or right, the rotation sensor 85 detects whether the rotation ofthe rotary encoding unit 12 is the leftward rotation or the rightwardrotation, based on the timing of the signals A and B shown in FIG. 16.If the rotation of the rotary encoding unit 12 is detected to be therightward rotation, the rotation sensor 85 sends a rightward rotationpulse to a counter (1) 86 of the embedded controller 68. Conversely,should the rotation of the rotary encoding unit 12 be detected to be theleftward rotation, the rotation sensor 85 sends a leftward rotationpulse to a counter (2) 87 of the embedded controller 68.

The embedded controller 68 executes the jog dial state monitor program70E to monitor the variation of the counter (1) 86 and the counter (2)87, difference therebetween and whether or not the jog dial 4 has beenpushed, by polling at intervals of 5 ms.

First, at step S1 in FIG. 15, the count value counter 1(T−1) at time T−1is subtracted from the count value Counter 1 (T) at current time T ofthe rightward rotation pulse to find the variation Counter 1 of thecount value of a counter 87.

Then, at step S2, the count value Counter 1(T−1) at time T−1 issubtracted from the count value Counter 1 (T) at current time T of theleftward rotation pulse to find the variation Counter 2 of the countvalue of a counter 87.

At step S3, the difference between the variations of the count values,that is the difference between the variation Counter 1 and the variationCounter 2, is found. If this difference between the variations isnegative, the rotation is leftward.

On the other hand, the pressed state of the jog dial 4 is acquired atstep S4. At step S5, the variations as found at step S3 are checked. Atstep S6, it is checked whether or not the pressed state of the jog dial4 has been changed. If it is verified that the variation is detected atstep S5, or that the pressed state has been changed at step S6, thecurrent pressed state of the jog dial 4 and the variation are notifiedby interrupt through an I/O register 71F to the jog dial driver 54D,started by the CPU 51.

If there is no change at step S6 in the pressed state of the jog dial 4,the program moves to step S8, where the polling is terminated and theprocessing as from step S1 is repeated after lapse of 5 ms.

After the power source switch 8 is turned on, the CPU 51 executes thejog dial state monitor program 54C in accordance with the procedureshown in FIG. 17.

That is, at step S31, it is perpetually monitored whether or not the jogdial 4 has been acted upon. It is also monitored whether or not theE-mail program 54A or other applications 54F1 to 54Fn have beenactivated. Here, the state of the jog dial 4 is monitored to monitor theprocessing from the jog dial state monitor program 70E on the side ofthe CPU 51 through the jog dial driver 54D, with the operation beingsubstantially the same as the operation explained with reference to FIG.14.

If a notice on the operation of the jog dial 4 is sent at step S32 fromthe jog dial driver 54D, the program moves to step S33 where it isverified whether or not there is any active application. If there is noactive application, the program proceeds to the launcher operation and,if otherwise, to an event operation. The launcher operation means theoperation of selecting the registered application.

The launcher operation is explained briefly. This launcher operation isvalid on the condition that there is currently no active application, asdescribed above. In the jog dial menu are displayed applicationspreviously registered in the launcher list. In the launcher list, thereare registered application associated with the jog dial.

When the launcher operation is executed, the jog dial menu indicatingthe launcher state is demonstrated on the LCD 7. In the jog dial menu,there is displayed and started a list of applications associated withthe jog dial.

Assume that, when the pre-set OS54E has been started by the CPU 51,there is no activated application, and the user has pressed the jog dial4 once in the direction indicated by arrow b in FIG. 4. The pushed stateof the jog dial 4 then is received by the jog dial driver 54D by theforwarding of the flag state through the I/O register by interrupt, asexplained with reference to FIGS. 14 to 16. So, the jog dial driver 54Droutes an actuation notice to the jog dial state monitor program 54Csimilarly executed by the CPU 51.

The CPU 51 then starts the application program pre-registered in thelauncher list in association with the jog dial for adjusting the volumeof the speaker 65, luminance of the LCD 7 and its contrast and selectingthe application, so that a jog dial menu shown in FIG. 18 isdemonstrated on the LCD 7 of the display portion 3 shown in FIG. 2. Inthis jog dial menu, there re displayed menu items “sound volume”,“luminance”, “contrast” and “selection of the application”, associatedwith the processing operations of the sound volume adjustment,adjustment of luminance on the display portion, contrast adjustment andthe selection of the application. In this example, the selector A isdisplayed as the initial state on the menu item “sound volume”.

When the user then scrolls, that is rotates, the jog dial 4 in thedirection indicated by arrow a in FIG. 4, for causing the movement ofthe selector A, the embedded controller 68 executes the calculations,explained with reference to FIG. 15, in accordance with the jog dialstate monitor program 70E, and notifies the calculated variation to thejog dial driver 54D executed on the CPU 51.

The jog dial driver 54D then routes an actuation notice to the jog dialstate monitor program 54C so that the CPU 51 causes the selector A to beshifted to a menu item desired to be executed by the user. If, when thejog dial menu of FIG. 17 is displayed on the LCD 7, that is when theselector A is demonstrated on the “sound volume”, the user rotates, thatis scrolls, the jog dial 4 downwards a pre-set distance or angle asindicated by arrow a in FIG. 4, the selector A shifts to the menu item“luminance”. If the user rotates the jog dial 4 further downwards, theselector A shifts to the menu item “selection of the application”, asshown in FIG. 20.

If, as a result of the rotating actuation by the user of the jog dial 4,the selector A has shifted to the menu item corresponding to the desiredprocessing, the user pushes the jog dial 4 down in the directionindicated by arrow b in FIG. 4, by way of performing the selectingoperation. So, if the selector A is displayed on the menu item“luminance”, as shown for example in FIG. 19, the sub-menu associatedwith the menu item “luminance” is displayed, as shown in FIG. 21. In thepresent example, six sub-menus “5” to “0”, corresponding to the sub-menu“5” selected when the luminance is to be maximum through to the sub-menu“0” selected when the luminance is to be minimum, are displayed. Theamount of the variation of the jog dial 4 corresponding to the rotatingprocessing of the jog dial 4 by the user is found by the processing bythe embedded controller 68 shown in FIG. 15 and is sent to the jog dialdriver 54D, while being monitored by the jog dial state monitor program54C, to cause movement of the selector B.

On the other hand, if the selector A is displayed on the menu item“selection of the application”, as shown in FIG. 20, the sub-menucorresponding to the menu item “selection of the application”, isdisplayed by the selecting operation by the user, as shown in FIG. 22.In the present example, the sub-menu item “word processor”, selected onstartup of a word processor application, sub-menu item “E-mail” selectedon startup of an E-mail program, sub-menu item “table calculations”selected on startup of a table calculation program, sub-menu item“Internet” selected on startup of an Internet program and the sub-menuitem table “calculator” selected on startup of a table calculatorprogram, are demonstrated. In the present example, the selector B on thesub-menu is demonstrated on the topmost submenu item.

The user then rotates the jog dial 4 to cause the selector B to be movedto the submenu item desired to be selected, and then presses the jogdial 4 to perform the selecting operation. This selects the submenu itemdisplayed on the selector B to permit the corresponding processing to beexecuted. If, for example, the submenu item “3” in the example of FIG.21 is selected, the luminance corresponding to the submenu item “3” isset. On the other hand, if the sub-menu item “Internet” is selected inthe example of FIG. 21, the Internet program is started.

The case in which, after turning on of the power source switch 8, theCPU 51 executes the jog dial state monitor program 54C, and there is anactive application at step S33 in FIG. 17, is explained. This casecorresponds to the event operation described above. The applicationneeds to be associated with the jog dial and specifically is to be apre-set application program having a picture displaying function. In thepresent instance, the map of Japan shown in FIG. 23 is displayed on theLCD 7 by the application program. If the user rotates the jog dial 4 inthis case, the picture is enlarged at a point indicated by a printer asthe center, as shown in FIG. 24.

If the jog dial 4 is rotated in the opposite direction to that when thepicture is enlarged, the picture is contracted, that is restored to theoriginal size. So, in the pre-set application program having the picturedisplaying function associated with the jog dial, the picture displayedon the LCD 7 can be contracted or enlarged in association with therotating operation of the jog dial 4.

The above-mentioned applications as the specified examples are both thejog dial related software. However, not all applications stored in theHDD 67 and memorized in the RAM 54 after completion of the OS54E startupare not associated with the jog dial 4. For example, the application54F3 is not associated with the jog dial. The processing on the jog dialwhich the CPU allocates to the jog dial related application and to thejog dial unrelated application. For this reason, the jog dial relatedapplication notifies to the jog dial state monitor program 54C executedon the CPU 51 in accordance with the procedure shown in FIG. 26.

First, at step S61, the jog dial related application declares to the jogdial state monitor program 54C that it is a jog dial relatedapplication. The jog dial state monitor program 54C then at step S62adds the application software to the list of the jog dial relatedsoftware.

Although not shown specifically, in the above explanation, the jog dialmenu display may also be made known to the user in the form of a jogdial guide as a display proper to the application.

That is, at step S63, the jog dial related application notifies theillustration of the jog dial operation in the current state to the jogdial state monitor program 54C by a letter string. At step S64, a jogdial window 90 shown in FIG. 27 is displayed at step S64 to demonstrateletter strings, such as “jog dial guide”, “zoom”, “in”, “fit” or “out”.

The jog dial related application at step S65 changes the letter stringsdepending on the state of the activated window to rewrite the list ofthe jog dial state monitor program 54C. So, if the jog dial relatedapplication is active, the display of the jog dial window 90demonstrates, in letter strings, the illustration as to which operationis to be performed by the application subject to jog dial actuation.

The application is classed into a jog dial related application and a jogdial non-related application, as discussed above. The distinctionbetween the jog dial related application and the jog dial non-relatedapplication is made in accordance with the procedure shown in FIG. 24.

First, at step S51, the UI which performs an event operation isdisplayed on a window.

It is then checked at step S52 whether or not the application is a jogdial related application corresponding to a pre-registered activeapplication and a decision is given at step S53. If, at step S53, theapplication is verified to be a jog-dial non-related application, theprogram moves to step S54 to make a message notice proper to the jogdial in accordance with the procedure shown in FIG. 15. If theapplication is a jog-dial non-related application, the program moves tostep S55 to make standard message notice.

Specified examples of the jog-dial related application and the jog-dialnon-related application are shown below.

A first specified example is an application software showing a tag on adesk top for realizing the time-shiftable desktop environment, asdisclosed in JP Patent Application No. 11-108535 (Internal PriorityApplication H-10-321772) proposed by the present Assignee. FIG. 25 showsexemplary picture in case temporal cooperation is made between anapplication for realizing a time-shiftable desktop environment and anapplication of a picture browser. It is assumed that, in FIG. 25,retrieval is made on a desk top by an application realizing thetime-shiftable desktop environment and time shifting is made until agiven letter string presents itself on the desk top. It is assumed that,in the present embodiment, a letter string “wearable” is inputted to aretrieved letter input space 125, the letter string “wearable” isretrieved by an application realizing the time-shiftable desktopenvironment and the icon or the letter string used at a time of aconference pertinent to the on a time-shiftable desktop window 200letter string “wearable” is displayed on the time-shiftable desktopwindow 200. It the present case, the desktop environment of theconference held on Nov. 20, 1998 Friday at 3 pm is displayed on thewindow 200, as may be seen from the displayed contents of a date andtime display 127. If the “application time” is determined by theapplication realizing the time-shiftable desktop environment asdiscussed above, the time information is notified to a picture browser,which, on reception of the time information, displays the photo pictureshot at the adapted for time (time during conference). In the presentcase, a photo picture shot on Nov. 20, 1998 at 4 pm is displayed on thewindow 201. If conversely the picture browser is acted upon, the stateof the desktop at a time point of the picture photographing isregenerated. Therefore, it can be understood under which situation thephoto is shot, even though no caption (explanation) is attached to thepicture. If the application is associated with the event operation ofthe jog dial 4, the temporal moving direction and quantity of thetime-shiftable desktop 200 can be acted on by the jog dial 4. That is,for example, a jog dial window 90 may be displayed on the lower rightcorner of the time-shiftable desktop 200 to realize temporal movement tothe past or to the future in association with the scrolling of the jogdial 4.

A second specified example is the Smart Capture (trademark) as a toolfor capturing still and moving pictures of a digital video camera.

A third specified example is the MediaBar as a music actuating tool. Inthis MediaBar, playback of the next number or the previous number may beselected or playback may be paused by scrolling with e.g., a jog dial ora keyboard.

A fourth specified example is the SmartPad (trademark) as a handwritingmemo tool employing a touch pad 6. The touch pad 6 is used as absolutecoordinate detection means. The handwritten memo input from the touchpad 6 is processed by the drawing application and displayed.

As a fifth specified example, a schedule management tool, for example,may be used.

The setting of the jog dial is explained. By actuation of a “set up”button of the jog dial window 90, the picture may be shifted to a jogdial setting picture 300 shown in FIG. 26. For example, an applicationcan be registered in an application list started from a launcherapplication. The setting is registered by selecting a softwareregistration area 301 and attaching a jog dial mark to the desiredapplication. The setting registration comes to a close on clicking an OKbutton.

A label software of the present embodiment is now explained.

The label software of the present embodiment is an application programfor realizing, on a desktop screen of a personal computer, the operationof exploiting a tag sheet attached as an index mark tio a paperdocument, writing a memo on the tag sheet and affixing it somewhere foruse as a reminder. In the present embodiment, the label sheet displayedon the desk top screen is called a label sheet and an applicationprogram for displaying the label on the desk top is called the labelsoftware.

The label software of the present embodiment has the functions ofhandling the text of letters or symbols, still pictures, speech or musicsound, as an object that can be affixed to the label as a tag sheetdisplayed on the desk top, editing a text affixed to the label, therecording and/or reproducing function of the sound affixed to the label,capturing/displaying a picture to be affixed to the label andcooperating with a application software fir capturing the picture fromthe CCD cam-era attached to the personal computer. The label software ofthe present embodiment also includes the functions of preparing a labelhaving a change hysteresis as the temporal management function, fullysupporting the jog dial with respect to the temporal management functionand of handling a link as an object affixed to the label.

In the structure of data handled by the label software of the presentembodiment, having these functions, there are three items, namely aproject, a label and an object. FIG. 27 shows the relationship betweenthese data.

The adapted for project is a set of all label data. Usually, a projectformulates only one project. In a project, there are all labelinformation of past, present and future. However, for furnishing samplecontents or project information exchange over the Internet, the labelsoftware of the present embodiment supports the project switching andaddition. The project will be explained in detail subsequently.

The label corresponds to a tag sheet on a desktop. The label has theinformation as from its formulation until its disposal. This informationis the information on the entire operations which the user performedthrough a personal computer on the label as from its formulation untilits disposal, such as size or color change of the label, textcorrection, picture change or sound change. Although the label positioninformation always has the attributes of displaying the latestinformation, the information between the labels, between the windows orbetween the label and the window is not held. The label may be classedinto three sorts, that is the current label, past label and the futurelabel. The current label is a label prepared at a time ahead the currenttime and which has not yet been deleted at the current time point. Therelationship between the time of preparation of the current label, thecurrent time and the end (deletion) time is (preparing time≦currenttime<end time (deletion time). The past label is a label already deletedat the current time point. The relationship between the time ofpreparation of the current label, the end (deletion) time and thecurrent time is (end time (deletion time)<preparing time≦current time).The future label is a label not formulated as yet at the current timepoint, and the preparing time is set to a future time point. Therelationship between the current time, the time of preparation of thecurrent label and the end (deletion) time is (the current time<the timeof preparation<the end (deletion) time. The label will be explainedsubsequently in detail.

The object is data affixed in the label and may specifically beenumerated by a text object, a picture object, a sound object and a linkobject. First, the overall structure of a picture is explained.

The main constituent parts of a desk top screen when the label softwareof the present embodiment is executed are explained. First, the overallstructure of a screen is explained.

The label software state of the present embodiment (state of theapplication) may be classed into a normal mode and a time view mode.

The normal mode is a state in which a label has been affixed to the desktop in a state other than the time view mode. FIG. 28 shows an exampleof a desk top picture in the normal mode. In this figure, the label isdenoted by a reference figure L. in this normal mode, an icon IL of thelabel software of the present embodiment is displayed on a task tray TTof the task bar TB on the desktop screen. By accessing (clicking) thisicon IL using a pointing device, such as mouse, it is possible tocontrol the entire functions of the label software application of thepresent embodiment.

The time view mode is a mode in which temporal operation by the labelsoftware of the present embodiment is possible and which can be classedinto three states of the present, past and future modes. FIGS. 29 to 31show an illustrative structure of a desktop screen in the present mode,an illustrative structure of a desktop screen in the past mode and anillustrative structure of a desktop screen in the future mode,respectively. As may be seen from these figures, the current state, paststate and the future state of the label contained in the project aredisplayed for the present, past and future modes, respectively. On thedesktop screen of FIGS. 29 to 31, letters “present”, “past”, and“future” indicating the respective modes are displayed at the center andat the four corners of the desktop screen of FIGS. 29 to 31. By theseindications, the user is able to visually recognize the mode whichprevails, that is the present mode, past mode or the future mode. Also,in the time view mode, the icon IL of the label software of the presentembodiment is displayed on the task tray TT of the task bar TB of thedesktop screen.

On switching to the time view mode, the entire area on the desktop iscovered by a label software picture and a label is displayed thereon. Ifthere are plural monitors, the entire areas of the entire monitors arecovered by a label software picture and a label is displayed thereon. Atthis time, a time view console TVC for enabling the display/change ofthe time now acted on is displayed on the screen. Meanwhile, the timeview console TVC is displayed in the standard state on the upper part ofthe screen. FIGS. 29 to 31 show an example of displaying the time viewconsole TVC in the lower portion of the screen. The time of the state inwhich the desktop display is made in the time view mode is referred tobelow as the operation time.

The window screen of the label displayed on the desktop is made up of aplay/pause button, a stop button, a link button, a menu button, anobject that can be affixed to the label (text, picture and sound), icons(alarm, repetition) and the like. FIG. 32 shows an example of the windowpicture of the label L. In the case of the label L, shown in FIG. 32,the play/pause button PB, stop button SB, link button LB and the menubutton MB are displayed and the text, sound, picture and the link areaffixed in the label L. Meanwhile, the state in which the picture isdisplayed is shown.

The play/pause button PB is used for commanding the playback start andthe pause of the sound when the label L contains a sound object. Thatis, if the label L contains the sound object, and the play/pause buttonPB is pressed, such as by mouse click, the sound is reproduced, whereas,if the play/pause button PB is pressed (clicked) during the soundreproduction, the sound reproduction is paused. On the other hand, theplay/pause button PB is PB is associated with a tool chip TCt indicatingthe play time (sound recording time) shown in FIG. 33, such that, when acursor MC is moved on the button PB, the tool tip TCt indicating theplay is displayed.

The stop button SB is used for stopping the sound reproduction. If thestop button SB is pressed (clicked) during the sound reproduction, thesound reproduction is stopped.

The link button LB is used for opening the file of the link destinationassociated with the label L and for displaying the window of the HTML(Hypertext Markup Language). If a file path is set as an address of thelinking destination on the label L, and the link button LB in the labelwindow of FIG. 32 is pressed (clicked), the file set by the file path isopened. If the URL (uniform resource locator) is specified as a linkingaddress in the label L, and the link button LB is pressed (clicked), thewindow of the HTML (Hypertext Markup Language) is displayed. Also, thelink button LB is associated with the tool chip TCl indicating the linkcontents (file path or URL of the linking destination), such that, whenthe cursor MC has been migrated onto the link button LB, the too chipTCl indicating the link contents is displayed.

The menu button MB, arranged on the right upper end of the label window,is used for displaying the menu of all operations relevant to the label,such as file, addition of new labels, time, label, help etc. If the menubutton MB is pressed (clicked), the menu items, such as file, additionof desktop screen, time, label, help etc are displayed as the pull-downmenu in the vicinity of the menu button MB. Meanwhile, when the rightbutton of the mouse is clicked in each part of the lebel, or theapplication key is pushed with focussing, menu items (context menuitems) are displayed as when the menu button MB is clicked. Thepull-down menu activated on clicking the menu button MB on the labelwindow and the context menu by the application key will be explainedsubsequently in detail.

Depending on the status or the setting of the label, an iconrepresenting the current state is displayed on the upper right part ofthe label L (left: neighboring side of the menu button MB, as anexample). The icon may be classified into an alarm icon IA and arepetitive icon IR as shown in FIG. 35. The alarm icon IA is displayedwhen an alarm is set on the label, whereas the repetitive icon IR isdisplayed when a repetitive display is set.

The label in the state of the time view mode may sometimes be acorrection-inhibited label. The correction-inhibited label is varied incolor in its edge from the color of the edge of the correctable labelfor distinction from the correctable label. That is, in the presentembodiment, distinction is made by the label color so that the user willcomprehend due to which state of the label it is uncorrectable. Forexample, the uncorrectable label is differentiated from the correctablelabel by having a purple or blue color. For example, if the label edgecolor is “purple”, it indicates that the present label is of the pastmode or the future mode and cannot be corrected (correction-inhibitedlabel). If the label color is “blue”, it indicates that the label is thepast label, which is not corrected for any modes.

The time view console TVC has two window states, that is a state of abar-shaped window shown in FIGS. 29 to 31 and in FIG. 36 and a state ofa floating window as shown in FIG. 37. That is, the time view consoleTVC can be dragged by a pointing device, such as a mouse. When the timeview console TVC is moved upwards or downwards in the screen, it is in abar-shaped window, as shown in FIGS. 29 to 31 and in FIG. 36, andotherwise in a floating-state window, as shown in FIG. 37. Although thescreen configuration differs in the bar state and in the floating state,the function of the time view console is the same.

The bar-state window of the time view console TVC shown in FIG. 36 ismade up of a window title portion wt, the Christian era gauge unit cg,current button bb, an operation time display unit oti, an up-down buttontub and tdb, time increasing/decreasing step selection list box ssl, atime increasing/decreasing step selection menu button sb, a menu buttonmb, a closure button cb, a help button hb and a rotation animation unitra.

The window title unit wt displays a title of the window, a time view inthe present example, and displays only the title. That is, the windowtitle unit wt is provided for clarifying that the applicationresponsible for the current picture in its entirety is the labelsoftware.

The Christian era gauge unit cg is provided for clarifying for the userat a glance to which time in the Christian era corresponds the labelcurrently displayed. This Christian era gauge unit cg is displayed sothat the time as the label is displayed on the screen will beperpetually at the center of the gauge. A yellow vertical line, forexample, is also displayed for clearly displaying the time. That is, thetime at the center portion of the Christian era gauge unit cgcorresponds to the label of the past or future label, or to the currenttime, instead of corresponding to the real time (current time of thereal world). The Christian era gauge unit cg in the example of FIG. 36is an illustrative display for a case wherein the time of the state inwhich a label is displayed on the screen, that is the time at the gaugecenter, is November 1999. A yellow vertical line 1 e is displayed at thegauge center. In the Christian era gauge unit cg, a red vertical line 1r indicating that the real time (current time of the real world) ise.g., May 1999. That is, according to Christian era gauge unit cg, therelative position between the time corresponding to the displayed label,such as November 1999, and the real time, such as May 1999, can berecognized readily.

The current button bb is used for commanding restoration from the timecorresponding to the displayed label to the real time (current time ofthe real world). Meanwhile, if the time is reset to the current time(current time of the real world) by the current button bb, the state ofthe label software (state of the application) is kept in the time viewmode.

The operation time display unit oti displays which time state is thestate in which a label is displayed on the screen. In the example ofFIG. 36, it is the state of the label on Nov. 11, 1999, 3.27.9 pm, thatis displayed on the screen.

The up-down buttons tub and tdb are used for advancing or delaying thetime demonstrated on the operation time display unit oti by specifiedtime advancing delaying unit (time advancing delaying step). Assume thatthere is focus on the operation tune display unit oti and that one ofthe year, month, day, hour, minute and second on the operation timedisplay unit oti is activated. If now the up-button tub is pushed, thevalue of the activated portion is increased by a specified timeincreasing/decreasing unit (time increasing/decreasing step). In thelabel software of the present embodiment, the function which is the sameas that of the up/down buttons tub and tdb may also be implemented byrotation of a wheel of a mouse fitted with the wheel, up/down operationof a cursor key or rotation of the jog dial 4. That is, in the presentcase, if there is a focus on the operation time display unit oti, one ofthe year, month, day, hour, minute and second on the operation timedisplay unit oti is activated, and the wheel of the mouse fitted withthe wheel is rotated, the up/down cursor key on a keyboard is pushed, orthe jog dial 4 is rotated. The value of the activated portion isincreased or decreased in specified time increasing/decreasing units(time increasing/decreasing steps) to advance or lag the time.

The time increasing/decreasing step selection list box ssl demonstratesthe time increasing/decreasing unit (time increasing/decreasing step) incase the time of the operation time display unit oti is increased anddecreased. Stated differently, there is displayed in the timeincreasing/decreasing step selection list box ssl the timeincreasing/decreasing unit (time increasing/decreasing step) of anactivated one of the year, month, day, hour, minute and second, as theactivated time display portion, demonstrated on the timeincreasing/decreasing step selection list box ssl in the example of FIG.36. In the present embodiment, the time increasing/decreasing units(time increasing/decreasing steps) are 100 years, 10 years, 1 year, 1month, 1 hour, 1 minute, 1 second and varying time point. One of thesetime increasing/decreasing steps is displayed in the timeincreasing/decreasing step selection list box ssl. Meanwhile, the timeincrease/decrease in varying time units means increasing/decreasing thetime with the time as from a time point when certain operation is madeon the label by the user to modify the label, such as label movement,size change or object correction, that is a time point the label stateon the desktop is changed, until the time point of occurrence of thenext change, as one unit. So, if the time is increased or decreased interms of the varying time units, the time interval of change with theincrease/decrease at the change point is not constant.

The time increasing/decreasing step selection menu button sb is used forspecifying the time increasing/decreasing steps demonstrated on the timeincreasing/decreasing step selection list box ssl by a menu selectionbutton. Stated differently, the time increasing/decreasing stepselection menu button sb is used for selecting the time displayingportion, that is the year, month, day, hour, minute or second displayedon the operation time display unit oti, that is desired to be activated.If this time increasing/decreasing step selection menu button sb ispushed, that is clicked, the time increasing/decreasing units (timeincreasing/decreasing steps), such as 100 years, 10 years, 1 year, 1month, 1 hour, 1 minute, 1 second and on varying time unit, is displayedas a pull-down menu below the time increasing/decreasing step selectionmenu button sb. Therefore, by selecting the desired timeincreasing/decreasing step, the corresponding time displaying portionfrom the indications of the year, month, day, hour, minute and second isselected and activated. That is, if, for example, the 1 month isselected from the pull-down menu of the time increasing/decreasing stepselection menu button sb, the month displaying portion of the displayportions of the year, month, day, hour, minute and second is activated.In this state, rotation of the up/down buttons tub and tdb or the wheelof the mouse fitted with such wheel, thrusting the up/down cursor keydownwards or rotation of the jog dial 4 enables the month can bechanged.

Moreover, in the label software of the present embodiment, the samefunction as the function of selecting the time increasing/decreasingsteps by the time increasing/decreasing step selection menu button sbmay be realized by rotation of the up/down buttons tub and tdb or thewheel of the mouse fitted with such wheel, thrusting the up/down cursorkey downwards or rotation of the jog dial 4. That is, in the presentcase, if, with the focus on the operation time display unit oti, thewheel of the mouse fitted with such wheel is rotated, the left or rightcursor key is pressed down, or the jog dial 4 is rotated, one of thetime displaying portions arrayed in the left-and-right direction on theoperation time display unit oti, that is the year, month, day, hour,minute and the seconds, may be selected to the activated state.

If the time is increased/decreased by operation of the mouse fitted withthe wheel, it is possible to detect e.g., the continuous operation of akeyboard, rotational speed of the wheel of the mouse fitted with suchwheel or that of the jog dial to change the time advancing or timelagging responsive to the detected results in an accelerating fashion.This provides for facilitated movement to the target time. Meanwhile, ifthe time increasing/decreasing step selecting function is implemented bythe rotation of the mouse fitted with the wheel or the jog dial, it isnecessary to set the environment for affording the rotation of the mousefitted with the wheel, or the jog dial with the selecting function forthe time increasing/decreasing steps.

The menu button mb is used for demonstrating the entire operating menusrelevant to a project, such as file, addition of new labels or timelabels. If the menu button mb is pressed (clicked), operating menus,such as file, addition of new labels, time or label are displayed as thepull-down menu in the vicinity of the menu button MB. Meanwhile, whenthe right button of the mouse is clicked in each part of the time viewconsole TVC, or the application key is pushed with focussing, menu items(context menu items) are displayed as when the menu button MB isclicked. The pull-down menu activated on clicking the menu button mb onthe time view console and the context menu by the application key willbe explained subsequently in detail.

The closure button cb is a button for commanding closure of the timeview console.

The help button hb is used for commanding the display of the help windowused for checking into unclear points when a user acts on the labelsoftware of the present embodiment.

The rotation animation unit ra is used for visually demonstrating thetime shifting to the user by animation display in such a manner as torotate the rotation animation unit ra with changes in the operationtime. The direction of rotation is reversed when the time proceeds tofuture from that when the time proceeds to past. FIG. 38 shows only thevicinity of the rotation animation unit ra on the left end of the timeview console TVC in the bar state. If attention is directed to the →portion in the drawing, it may be seen how the rotation animation unitra is rotated in the sequence of (a), (b) and (c) in FIG. 38. By makingthe animation display in which the rotation animation unit ra is rotatedin this manner, it is possible to permit the user to recognize how thetime is changed.

The floating-state window of the time view console TVC shown in FIG. 37is made up of a window title portion wt, for indicating the title of thewindow, the time view console in the instant embodiment, a window menuunit wm for displaying the operating menu pertinent to the project, suchas file, addition of new label, time, label or help, the Christian eragauge unit cg, similar to that in the bar state window, a current buttonbb, an operation time display unit oti, an up-down button tub and tdb,time increasing/decreasing step selection list box ssl, and a timeincreasing/decreasing step selection menu button sb. Meanwhile, theclosure button for commanding the closure of the time view console inthe case of FIG. 37 is an “X” button. The window menu unit wm of thetime view console in the floating state will be explained subsequently.

The screen structure of an icon IL of the label software of the presentembodiment, as demonstrated on the task tray TT of the task bar TB onthe desktop screen, is hereinafter explained.

If, as the cursor is moved on the icon IL of the label softwaredisplayed on the task tray TT, the clicking by pressing the left buttonof the mouse is repeated, the label software of the present embodimentalternately repeats the “all display” state and the “all hide” state ofthe label. If the cursor is moved on the icon IL, and the left button ofthe cursor is pushed twice by way of double clicking, the label softwareof the present embodiment performs the default operation pre-set by theuser by e.g., the environment setting, such as addition of new labels,addition of new labels and the sound recording, addition of new labelsand acquisition of captured picture or entrance to the time view mode.If, as the cursor is moved on the icon IL, the right button of the mouseis clicked, the label software of the present embodiment displays theentire operating menu for the project of the label software. FIGS. 39 to42 show an illustrative display of an operating menu when the state of“all display” is specified for the label in the normal mode, anillustrative display of the operating menu when the state of “all hide”is specified for the label in the normal mode, in the present mode, anillustrative structure of a desktop screen in the past mode and anillustrative structure of a desktop screen in the future mode,respectively.

The icons IL are adapted for being different in color in the present,past and future modes. The icons of different designs are displayed inthe “all hide” state and “all display” state for the present mode. Forexample, FIGS. 43( a), (b) and (c) show an example of the icon IL of thepresent mode, an example of the icon IL of the future mode and anexample of the icon IL in the “all hide” state, respectively. Thispermits the user to know the current state visually without opening themenu on the task tray TT (menu of FIGS. 39 to 42). The menu in the iconIL on the task tray TT will be explained in detail subsequently.

In the label software of the present embodiment, there exist no mainmenu itself, however, the variable menus, such as those described aboveare displayed. The menus displayed are the menu button MB on the labelL, menu button mb on the time view console TVC and the context menu(menu displayed on clicking the right button of the mouse or pressingthe application key).

First, the items of the pull-down menu displayed on clicking the menubutton MB on the label window are explained. The menus by the menubutton MB of the label window contain menu items for the entireoperations concerning the label. Among the items of the operating menufor the label, there are such items as “time view mode”, “text”,“sound”, “picture”, “memo”, “link”, “label”, “arraying”, “backgroundcolor”, “layout”, “property”, “file” or “label deletion”.

The menu item “time view” are used for switching display/non-display ofthe above-mentioned time view console.

The menu items of the “text” are those concerning the editing of textsby the above-mentioned word-processor software and are typified by “textediting”, “clipping”, “copying”, “pasting”, “deleting”, “word-wrapping”and “font”. In “Text editing”, the text pasted on the label can beclipped into a clipboard. In “copying”, the test pasted on a label canbe copied into the clipboard. In “deleting”, the text pasted on thelabel can be deleted. In “word-wrapping”, word-wrapping occurs indisplaying the text. In “font”, the font used for text display can beset.

The menu item “sound” is used for operating the sound, and is typifiedby “play”, “clipping”, “copying”, “pasting”, “deleting”, “start” and“set to original size”. In the item “play”, the sound object can bereproduced by e.g., a music-related operating tool. In the item “pause”,the stop operation becomes possible during sound reproduction. In theitem “sound recording”, the sound can be recorded newly. In the item“clip”, the sound object pasted on a label can be clipped on aclipboard. In the item “copy”, the sound object pasted on a label can becopied on a clipboard. In an item paste“ ”, the sound object on theclipboard can be pasted on a label. In an item “delete”, a sound objectcan be deleted.

The menu item “picture” operates on a picture and includes such items as“display of a captured picture”, “shot”, “clip”, “copy”, “paste”,“delete” and “change to original size”. In the item “display thecaptured picture”, an application for capturing a picture, such asstill/moving picture capture tool, as described above, is started todisplay a finder. In an item “shot”, a captured picture can be pasted ona label. In an item “clip”, a picture pasted on a label can be clippedon a clipboard. In an item “copy”, the picture pasted on a label can becopied on a clipboard. In an item “paste”, the picture on the clipboardcan be pasted on a label. In an item “delete”, the picture pasted on alabel can be deleted. In an item “set to original size, the picture canbe displayed to an original size”.

The menu item “memo” is for an operation for handwriting memo by theabove-mentioned handwriting tool and includes such items as “clip”,“copy”, “paste”, “delete”, “start” and “set to original size”. In theitem “clipping”, the handwritten memo pasted on a label can be clippedinto a clipboard. In the item “copying”, the handwritten memo pasted ona label can be copied into a clipboard. In the item “pasting”, thehandwritten memo in a clipboard can be pasted on a label. In the item“deleting”, the handwritten memo pasted on a label can be deleted. Inthe item “start”, a handwriting application for reading the handwritteninput through a touch-pad can be started. In the item “set to originalsize”, a picture of the handwritten memo can be displayed with anoriginal size.

The menu item “link” concerns the link operation and comprises suchitems as “link editing”, “opening the link”, “clipping”, “copying”,“pasting” and “deleting”. In the item “link editing”, the link pasted onthe label can be edited on a dialog. In the item “opening the link”, thefile path pasted on the label or corresponding to the URL can be opened.For example, in the case of a web (Web) page, the browser can be startedto display the page. In the item “clipping”, the link pasted on a labelcan be clipped into a clipboard. In the item “copying”, the link pastedon a label can be copied into a clipboard. In the item “pasting”, thelink in the clipboard can be pasted on a label. In the item “deleting”,the link pasted on the label can be deleted.

The menu item “label” concerns the operation on the label and includessuch items as “always forward” and “backward”. In the item “alwaysforward”, labels can always be displayed ahead, whereas, in the item“backwards”, labels can be displayed at the rearmost position.

The menu item “arraying” concerns the operation of arraying labels andinclude such items as “arraying at the left end of a picture”, “arrayingat the right end of a picture” and “arraying at the lower end of apicture”. In these items, the labels can be arrayed at the left end, anupper end, a right end and at a lower end of the picture, respectively.

The menu item “background color” concerns the operation on thebackground color of a label. The background color of a label can be seton selecting the menu items of the menu item “background color”.

The menu item “layout” concerns the label layout operation and includessuch items as “re-layout by default”, “custom layout”, “expand/contractto label size”, “keep the picture aspect ratio”, “set picture tooriginal size” and “set handwritten picture to original size”. In the“re-layout by default”, re-layout becomes possible with layout default.In the item “custom layout”, layout by a user is possible. In the item“expand/contract to label size”, the pasted object can beexpanded/contracted to the label size when the label size is changed. Inthe item “keep the picture aspect ratio”, the aspect ratio of theoriginal picture can be kept in re-sizing a picture. In the item “sethandwritten picture to original size”, the handwritten picture can bedisplayed to the original size.

With the menu item “property”, the label property can be displayed.

The menu item “file” is used for file operation and includes “import”and “export”. With the item “import”, it is possible to paste file data(text data, picture data and sound data. With the item “export”, it ispossible to write object data into a file.

In the menu item “label deletion”, it is possible to delete labels.

The context menu by an application key on a label window is nowexplained. In the context menu on the label window, menu contents arechanged depending on which position on the label has been clicked by theright button of the mouse. Specifically, the menu contents are changeddepending on whether the position clicked by the right button of themouse is on the “text object”, “picture object”, “play/pause button PBor on the stop button SB”, that is on the “sound object”, on the “linkbutton LB or on the” link object, on the “handwritten picture” or onother sites (on the “label”). The menu items represented on these fivesites on the label are hereinafter explained. The contents actuallydisplayed are the same as explained in connection with the button menuMB on the label L and hence are not explained for simplicity.

The context menu on the “text object” includes such items as “textediting”, “clipping”, “copying”, “pasting”, “deleting”, “word-wrapping”,“font”, “import file” and “export file”.

The context menu on the “picture object” includes such items as “displaycapture picture”, “shot”, “clipping”, “copying”, “pasting”, “deleting”,“set to original size”, “import file” and “export file”.

The context menu on the “sound object” includes such items as “play”,“pause”, “stop”, “record”, “clipping”, “copying”, “pasting”, “deleting”,“import file” and “export file”.

The context menu on the “sound object” includes such items as “linkediting”, “open link”, “clipping”, “copying”, “pasting” and “deletion”.

The context menu on the “handwritten picture” includes such items as“clipping”, “copying”, “pasting”, “deletion”, “start” and “set tooriginal size”.

The context menu on the “handwritten picture” includes such items as“insert/edit”, “always ahead”, “backward”, “array”, “layout”,“background color”, “layout”, “property”, “import file”, “export file”and “label deletion”. The context menu on the “insert/edit” includessuch items as “text editing”, “recording”, “shot”, “link editing”,“display capture picture” and “from clipboard”. The context menu on the“array” includes such items as “array to the left end of picture”,“array on upper end of picture”, “array on right end of picture” and“array on lower end of picture”. The context menu on the “layout”includes such items as “Re-layout”, “custom layout”, “expand/contract tolabel size”, “keep picture aspect ratio”, “set picture to original size”and “set handwritten picture to original size”.

The context menu on the “custom layout” includes such items as“re-layout by default”, “expand/contract to label size”, “keep pictureaspect ratio”, “set picture to original size”, “set handwritten pictureto original size” and “edit end”.

The pull-down menu item by clicking the menu button mb of the bar-statetime view console is explained. The menu by the menu button mb of thetime view console include menu items of the entire operations concerningthe time view mode. The menu by the menu button mb of the time viewconsole includes menu items of the entire operations concerning the timeview mode. The operating menu items in the time view console includesuch items as “addition of new labels “current time”, “advance time”,“delay time”, “time increasing/decreasing interval”, “time view sound”,“display capture picture”, “label”, “array”, “project”, “setting”,“retrieve help”, “on label software” and “close console”. Meanwhile,explanation on the menu overlapped with the task tray icon as laterexplained is omitted.

In the item “add new label”, the label formulated during the operatingtime (as from the current time) can be added. The item “addition of newlabel” includes such items as “text label”, “sound label”, “from capturepicture”, “from clipboard” and “from import file”.

In the item “current time”, it can be set to be synchronized to thecurrent time.

In the item “advance time”, it becomes possible to advance time in thefuture direction with the time increasing/decreasing interval as set.

In the item “delay time”, it becomes possible to advance time in thepast direction with the time increasing/decreasing interval as set.

In the item “time increasing/decreasing interval”, it is possible to setthe specified time increasing/decreasing step used in timeincreasing/decreasing with the specified time increasing/decreasingstep. The item of the “time increasing/decreasing interval” includessuch items as the “100 years”, “10 years”, “1 year”, “1 month”, “1 day”,“1 hour”, “1 minute”, “1 second” and “varying time point”. With the item“varying time point”, the label state such as labelpreparation/correction/discarding is moved to a varied step, so that thetime interval is not constant.

The item of the “label” includes such items as “all display”, all hide“” and “all delete”.

The item of the “array” includes such items as “arraying at the left endof a picture”, “arraying at the upper end of a picture” “arraying at theright end of a picture” and “arraying at the lower end of a picture”.

The item of the “project” includes such items as “new preparation”,“open”, “close”, “import”, “export” and “property”.

With the item “close console”, the time console can be closed to returnto the current state.

The window menu item of the time view console in the floating state isexplained. The window menu item of the time view console in the floatingstate includes such items as “file”, “addition of new label”, “time”,“label” and “help”.

The item “file” includes such items as “display capture picture”,“project”, “time view sound”, “set” and “close console”, whilst the item“project” includes such items as “new preparation”, “open”, “close”,“import”, “export” and “property”.

The item “time view sound” includes such items as “set” and “closeconsole”.

The item “time view sound” includes such items as “text label”, “soundlabel”, “from capture picture”, “from clipboard” and “from import file”.

The item “time” includes such items as “current time”, “advance time”,“retract time”, “100 years”, “10 years”, “1 year”, “1 month”, “1 day”,“1 hour”, “1 minute”, “1 second” and “varying time point”.

The item “label” includes such items as “arraying at the left end of apicture”, “arraying at the upper end of a picture” “arraying at theright end of a picture” and “arraying at the lower end of a picture”,“display all”, “hide all” and “delete all”.

The item “help” includes such items as “retrieve help” and “on labelsoftware”.

The context menu by the application key on the time view console is nowexplained. Meanwhile, the contents really executed are the same as thoseexplained in connection with the menu button mb on the time view consoleand hence are not explained specifically.

The context menu on the time view console includes such items as“current time”, “advance time”, “retract time”, “timeincreasing/decreasing interval”, “time view sound and “close console.The item “time increasing/decreasing interval” includes such items as“100 years”, “10 years”, “1 year”, “1 month”, “1 day”, “1 hour”, “1minute”, “1 second” and “varying time point”.

The context menu by the application key on the background window in thetime view mode is now explained. Meanwhile, the contents really executedare the same as those explained in connection with the menu button mb onthe time view console and hence are not explained specifically.

The context menu on the background window in the time view mode includessuch items as “addition of new label”, “current time”, “advance time”,“retract time”, “time increasing/decreasing interval” and “closeconsole.

In the item “addition of new label”, the label formulated during theoperating time (as from the current time) can be added. The item“addition of new label” includes such items as “text label”, “soundlabel”, “from capture picture”, “from clipboard” and “from import file”.The item “time increasing/decreasing interval” includes such items as“100 years”, “10 years”, “1 year”, “1 month”, “1 day”, “1 hour”, “1minute”, “1 second” and “varying time point”.

The context menu in the icon of the label software displayed on the tasktray TT is explained.

The contest menu by the icon on the task tray TT includes such items as“add new label”, “time view mode”, “time view sound”, “display capturepicture”, “label”, “array”, “project”, “set”, “retrieve help”, “on labelsoftware” and “end”.

The items “add new label” includes such items as “text label”, “soundlabel”, “from capture picture”, “from clipboard” and “from import file”.With the item “text label”, it is possible to prepare a void label toplace it on the desk top. If setting of the label software is made sothat the time of preparation will be displayed, the time of preparationis introduced. With the item “sound label”, it is possible to preparethe label and to place it on the desktop. Sound recording is started assoon as the label is prepared. If setting of the label software is madeso that the time of preparation will be displayed, the time ofpreparation is introduced. With the item “from capture picture”, it ispossible to acquire the capture picture from the retrieving applicationof the capture picture, to prepare the label using the picture and toplace it on the desktop. If setting of the label software is made sothat the time of preparation will be displayed, the time of preparationis introduced. With the item “from clipboard”, it is possible to preparea new label from data on the clipboard to place it on the desk top. Theform of the clipboard that can be handled here is the memo from thetext, picture and from the handwriting application. If setting of thelabel software is made so that the time of preparation will bedisplayed, the time of preparation is introduced. If the data from theclipboard is the text, the time of preparation is displayed on theleading line and the text in the clipboard is displayed from the secondand following lines. With the item “from import file”, it becomespossible to prepare a new label from the file data to place it on thedesktop. The form of the file form that can be handled here is the memofrom the text, picture, sound and from the handwriting application. Ifsetting of the label software is made so that the time of preparationwill be displayed, the time of preparation is introduced.

With the item “time view mode”, it is possible to switch thedisplay/non-display of the time view console.

With the item “time view sound”, it is possible to switch the on/off ofthe sound generated during the time view mode.

With the item “display capture picture”, it is possible to start theretrieving application of the capture picture to display the finder forpicture retrieval.

The item “label” includes such items as “display all”, “hide all” and“delete all”. In the item “display all”, it is possible to display alllabels. In the item “hide all”, it is possible to hide all labelstemporarily. If the icon IL on the label software on the task tray TT,this attribute is reset to display all labels. If the label software isre-started, this attribute is reset. With the item “delete all”, alllabels currently displayed can be deleted.

The item “array” includes such items as “arraying at the left end of apicture”, “arraying at the upper end of a picture” “arraying at theright end of a picture” and “arraying at the lower end of a picture”.

The item “project” includes such items as “new preparation”, “open”,“close”, “import”, “export” and “property”. With the item “newpreparation”, it is possible to close the currently open project toprepare a new project. With the item “open”, it is possible to it ispossible to close the currently open project to open another project.With the item “close”, it is possible to close the currently openproject. With the item “close”, it is possible to close the currentlyopen project. With the item “import”, it is possible to add a label ofanother project of an archive form to the currently open project. Withthe item “export”, it is possible to export a project as a file(archive). With the item “property”, it is possible to display theproject property.

With the item “set”, the label, default layout, sound, image and theenvironment can be set.

With the item “retrieve help”, help can be displayed.

With the item “label software”, the version information etc of the labelsoftware can be displayed.

With the item “end”, the label software can be brought to a close.

With the label software of the present embodiment, “operation on aproject”, “operation on a label”, “operation on a time view”, “operationon a keyboard/mouse” and “operation on a jog dial” are possible.

The operation on a project” is first explained.

A project manages the entire labels belonging to the project. The labelsoftware of the present embodiment is so formulated that a project willnecessarily be opened on actuation.

In the light source of the present embodiment, project is formulated oninitial startup and when a new project preparation is selected from amenu. When preparing a new project, the project name is set and, ifthere is any pre-existing project, such project is closed to open a newproject.

A project is made up of a project file, a label file or a projectarchive file. The project file has the information on the entire projectand a label list, there being one project file for each project.

The label file has the information for individual labels, such as objectinformation, there being one label file for each label. The projectarchive file is the project information and the information on plurallabels contained in the project, and is prepared when exporting theproject. The contents are a project achieve prepared at the outset, suchthat, when preparing a project, the contents can be contained in thenewly prepared project. The project file and the label file belonging tothe project file are present in one folder.

When preparing the project, a dialog shown for example in FIG. 44 isdisplayed. The user enters a project name by this dialog. In thisfigure, the project name is the name of the lowermost folder of theproject, and is entered as the project file name. Meanwhile, thepre-existing project name cannot be used. As the project name, a projectcomment containing up to a maximum of 127 letters can be entered.

When preparing the project, the folder of the project name is formulatedand a project file is prepared therebelow. The as-prepared project hasno labels. However, if designation is made to include the contents, thelabel information is captured from the archive. The operation ofcapturing the contents is the same as the import of the project as laterexplained. When preparing the project, the time information at the timeof the project preparation is recorded as the internal data.

The project is opened on startup of the light source of the presentembodiment or on designation from the console menu. Meanwhile, onstartup of the label software, the project opened at the time ofprevious termination is opened. When the project is opened, the labelbelonging to the project is displayed on the desktop based on the timeinformation and the position information. Two or more projects cannot beopened simultaneously, so that, if there is any opened project, suchproject is closed.

When the project is closed, the currently opened project is closed. Atthis time, the labels belonging to the opened project are closed.

The project import means adding the entire labels contained in anotherproject in the archive form to the currently opened project. Inimporting the project, the file dialog is first opened on designation ofthe import menu. By this file dialog, the project archive file which theuser desired to add is designated. On selection of the project archivefile, a filter for checking the archive type is executed. The archivetype of the label encompasses three types, namely “no correction”, “setthe current time as start time” and “ask user as to start time”.Meanwhile, the archive type “no correction” is directly imported,without correcting the archive information.

When inquiring the user about the start time, a dialog specifying theinput time and the minimum time units to be specified, as shown in FIG.45, is displayed as the dialog for time setting for import. The userenters the start time by this dialog.

When the start time is inputted by the user by the dialog shown in FIG.45, the dialog shown for example in FIG. 46 is opened after executingthe file. The dialog shown in FIG. 46 is an import dialog of the projectdisplaying the project information. When the import is executed, thedata of the entire labels of the selected project archive file arecopied in the currently opened project, along with the label file.

If there are such files for import having the same hysteresis as that ofthe label present in the current project, or if the entire hysteresis ofone of the labels are fully coincident with the partial hysteresis ofthe other label, there is displayed a dialog designating the importingmethod, as shown for example in FIG. 47. On the dialog of FIG. 47, it isdisplayed whether both labels are identical or which one of the labelshas a longer hysteresis. In the example of FIG. 47, it is possible toselect a desired one of the respective items from the items “no labelsare imported”, “label overwriting with the import file” and “preparelabel copies”.

In the label software of the present embodiment, the labels contained ina project can be collectively saved in a sole archive file, that can becaptured into another project, as the project export. In exporting theproject, the dialog of the export of the dialog shown for example inFIG. 48 is displayed on the desktop. On the dialog of FIG. 48,respective settings “export file name”, “is the export file deleted fromthe current project?” and “are all labels exported or are labels thegenerating and deleting time points are both included in the specifiedtime range to be exported?” are made to prepare a project archive file.At the lower and of the picture of the dialog is displayed the number ofthe labels to be exported. The label export here means exporting theentire hysteresis of the label.

If then the user selects the project property, the label software of thepresent embodiment displays the dialog shown for example in FIG. 49 onthe desktop. In this dialog, such items as “project holder”, “projectcommand”, “project preparing time and ultimate updating time”, “numberof labels (total number, past, present and future)” and “range ofexistence of labels” are displayed. In the “project folder” is displayedthe project folder name, whereas, in the “project command”, theexplanation on the project asset on new preparation is displayed. Theinformation in this “project command” can be edited. The “range ofexistence of labels” denotes the range of existence of labels,specifically, the range from the oldest hysteresis of the entire labels(time of preparation of the oldest label) up to the latest hysteresis.If there is any label the time of deletion of which is not specified, acheck mark is attached to the item “there is a label the time ofdeletion of which is not specified”.

The “operation on the label” is explained.

As the “operation on the label”, such operations as “new preparation”,“addition of objects”, “correction of object”, “layout”, “arraying”,“property”, “import and export of object” and “label deletion” arepossible.

With the “new preparation”, among the operations on the labels, anobject inserted first can be specified when newly preparing the labels.Among the labels, newly prepared, there are “text level”, “sound level”,“from capture picture retrieving software”, “from clipboard” and “fromimport file”. In the newly prepared labels, the label preparing time, asa text object, is displayed in addition to the above object. Meanwhile,whether or not the time of preparation is to be displayed can be set bythe setting picture. Each object is displayed in accordance with thedefault layout as later explained. A label file for storing theinformation on a label is prepared simultaneously with the newpreparation of the label.

The “new preparation” includes new preparation for the future mode. Thatis, in the time view mode, labels prepared in future (future labels) canalso be added. In the new preparation for the future mode, when the newpreparation of the label is selected by a user, a property picture forthe new label, shown in FIG. 50, is displayed. When the user sets thelabel start time, label end time, repetition and alarm, the future labelcan be newly prepared. Meanwhile, the default value of the display timeof the property picture of FIG. 50 is the operation time at the timepoint and continuation is checked (on).

In the operation for the label “object addition”, an object can be addedto the label currently displayed. For newly inserting an object, therespective menu items “text”, “sound”, “picture”, “handwriting memo” and“link” are specified by the user from the menu button on the label. Inthe menu item “text”, respective operations of text editing, pasting,import file, and drag/drop operations are possible, whereas, in the“sound” menu item, respective operations of recording, importing filesand drag/drop operations are possible. In the menu item “picture”,respective operations of shot, pasting, importing files and drag/dropoperations are possible, whereas, in the “handwriting memo” menu item,the operation of pasting is possible. In the menu item “link”,respective operations of link editing, pasting, importing files anddrag/drop operations are possible. Meanwhile, two or more objects cannotexist for a sole label.

In the operation on the label “object addition, “object addition bydrag/drop”, “addition of object position and size” and “addition at thetime of time view”.

In the “object addition by drag/drop”, if the file icons of the text,sound and the picture are dragged and dropped in sites other than thelabel link button, respective objects are inserted into the label. Onthe other hand, if an optional file icon is dragged and dropped on thelabel or on the link button, as e.g., the control key and the shift keyon the keyboard are pushed simultaneously, the path of the file is addedas the link object.

In the “addition of object position and size”, the size and the positionof the added object follow the parameters of the default layout. If thetest object and the picture object are set so as not to overlap witheach other and if one of the objects is added newly, it is insertedbelow the pre-existing object.

In the “addition at the time of time view”, if the time view mode is thepresent mode, the operation similar to that for the normal mode can bemade. If the time view mode is the future mode, an object can be addedto the future label. As to the operation of object addition, onlyultimate results are recorded and become the initial setting for thelabel display. As for the label that cannot be added, the label frame isdisplayed in a purple color (present level) or in a blue color (pastlevel).

In the operation on the label “object correction”, “text correction”,“sound correction”, “picture correction”, “correction of handwritingmemo”, “link correction”, “correction in time view mode” and “pastingfrom clipboard” are possible.

In the “text correction”, if the text editing item is selected by theuser from the menu button MB, or the context menu mb, and the menu isselected, the editing dial having the present text as shown for examplein FIG. 51 is opened. In the dialog of FIG. 51, there are menus “file”,“edit” and “insert” in the text editing menu. The “file” has such itemsas “import file” and “text editing end”, such that, in the “importfile”, the text file can be selected and inserted, whereas, in the “textediting end”, the text editing can be closed to reflect the textcontents in the label. In the menu item “edit”, there are such items as“reset”, “clip”, “copy”, “paste”, “delete” and “select all”. In the menuitem “insert”, there are such items as “current time and date” and “timeand date of preparation”. In the “current time and date”, the time anddate of the present (real time) is inserted, whereas, in the “time anddate of preparation”, the label preparing time is introduced.

The “sound correction” is possible when the user selects the recordingwith the menu button MB or the context menu. There is displayed on thelabel a tool chip TCe indicating the recording time and the maximumrecording time, as shown in FIG. 52, whilst the play button PB ischanged to the recording button RB to advise the user of the fact thatrecording is going on. If the recording button RB is pushed duringrecording, the recording is paused and, if the recording button RB ispushed again, the recording is performed as from the paused point. Inthe “sound correction”, the existing sound data is overwritten.

In the “picture correction”, it is not possible with the label softwareof the present embodiment to correct the pre-existing picture object.For changing (correcting) the picture, a picture object is introduced totake the place of the pre-existing picture object.

For directly correcting the handwriting memo prepared by the handwritingapplication, for performing the “correction of the handwriting memo”,the handwriting application start is selected from the menu button MB orthe context menu. After editing by the handwriting application, pastingof the edited memo in the menu button MB or the context menu is selectedand newly introduced into the label.

The “link correction” is enabled by the user selecting the link editingitem from the menu button MB or the context menu. That is, when the userselects the item of link editing, the label software of the presentembodiment displays an editing dialog, having the current link, as shownfor example in FIG. 53, on the desktop. The editing dialog of the linkhas an editing box EB and a file reference button. In the dialog editingbox EB are stated URL such as the paths of the file or folder and thehome page address. For example, if the “file reference button” ispushed, the file dialog is displayed. By selecting the file to which thelink is desired to be produced, the path to the file is inputted to theedit box EB. The menu item of the dialog box of the link includes “file”and the “edit”. The menu item of the “file” includes such items as“reference” and “end of link editing”. The item “reference” is selectedfrom the file dialog and is the same as the file reference button. The“end of link editing” closes the link correction picture to reflect thelink contents in the label. The menu item “edit” includes such items as“reset”, “clip”, “copy”, “paste”, “delete” and “select all”. Thesecontents are standard operations and are not explained specifically.

As the “correction at the time of time view mode”, it is possible tocorrect the object for the label newly displayed for the future in thetime view mode. As for the object correction operation, only theultimate results are displayed to effect initial setting at the time oflabel display.

In the “pasting from clipboard”, the text, bitmap picture, WAVE file andthe handwriting memo in the clipboard can be pasted on the label. Ifonly one object that can be pasted on the label is present in theclipboard, it can be pasted on the label. If two or more objects thatcan be pasted on the label are present in the clipboard, a dialog suchas one shown in FIG. 54 is displayed on the desktop. Here, a check boxof data present in the clipboard is enable for display and checked datais pasted as a label object.

The “layout” for the label is determined with the default layout as areference. It is noted that this setting of the default layout isutilized during label preparation and during addition of new objects.The default layout may also be used when the user manifestly selects there-layout command.

In the default layout, there are parameters such as “label size (X×Y)”,“text margin (left end, upper end, right end)”, “picture margin (leftend, upper end, right end”, “layout to evade the text overlapping withthe picture” and “setting as to size change (re-layout and keep pictureaspect ratio)”. The “label size” is used so that the horizontaldirection will be of the maximum size and the vertical direction will beof the minimum size. The “text margin” and “picture margin” are definedas in FIG. 55 and set by the dialog shown in FIG. 56. The vertical sizeof each object in the vertical direction is determined andstretched/contracted by the object data. If, as a result of stretchingand contraction, the text object overlaps with the picture object, thelower object can be moved further downwards to evade overlap (settingitem: layout to evade overlapping of the text with the picture).

For the operation when the label size is changed, there are twosettings. One of these settings (re-laying out) is to lay out the objectagain if the label size is changed. In the absence of setting, the sizeof the internal object is not changed despite size changes in the label.The second setting (keeping the picture aspect ratio) is the setting asto whether or not the aspect ratio is to be kept in case there is changein the picture size. The above setting is made in a default label layoutpicture of the setting dialog of the present embodiment of the labelsoftware shown in FIG. 56. This setting may be made by displaying anddragging a sample, in place of inputting a numerical figure, as shown inFIG. 57.

With the present embodiment of the label software, layout can freely becustomized by a user from one label to another in place of the defaultlayout. For example, if a custom layout item is provided as the menuitem, and the custom layout is executed, the label L is displayed asshown for example in FIG. 58. There is drawn a dotted-line framecircumscribing each object and the mouse can be dragged and droppedwithin this frame for movement. Moreover, with the present embodiment ofthe label software, the object size can be changed. For changing thesize, the object is clicked to the selected state, in which state thelabel frame line is changed from a dotted line to a solid line. Inaddition, handles (e.g., a black small square) is displayed in the fourcorners and on the four sides. These handles can be dragged and droppedto change the object size.

Meanwhile, in the label software of the present embodiment, if, inchanging the label size, automatic stretching and contraction is on andthe aspect keeping is on, left and right margins are always keptconstant unless the picture is of the minimum size. On the other hand,the margins at the four corners of the text are kept at constant values.In this case, the four corner margins may transgress the label window inthe vertical direction of the picture in order to keep the pictureaspect ratio. If the automatic stretching/contraction is on and thekeeping of the aspect ratio is off, the four corner margins are alwayskept constant unless the text and the picture are of the minimum size.Also, if the automatic stretching/contraction is off and the aspectratio is on or off, the text and the picture may transgress the labelwindow. If, in all of these cases, the default layout is selected, thelabel size or the left-right margins and the upper margin are set atdefault values. The heights of the label, text and the picture areautomatically adjusted to values which are sufficient to display thepicture. The values which are sufficient to display the picture arethose with which all pictures can be displayed. The values which aresufficient to display the text are those with which all picture portionscan be viewed with the correct aspect ratio. A lower margin of the samesize as the upper margin is added to the label.

The “arraying” of the operation on the label includes “arraying at theleft end of a picture”, “arraying at the upper end of a picture”“arraying at the right end of a picture” and “arraying at the lower endof a picture” as sorts of arraying. In the “arraying at the left end ofa picture”, labels are arrayed side-by-side from the upper left end ofthe picture in a downward direction. When the lower end of the pictureis reached, the labels are arrayed in similar manner with a shift of onerow towards right. In the “arraying at the upper end of a picture”,labels are arrayed side-by-side from the upper right end of the picturein a rightward direction. When the rightward end of the picture isreached, the labels are arrayed in similar manner with a shift of onerow downwards. In the “arraying at the right end of a picture”, labelsare arrayed side-by-side from the upper right end of the picture in adownward direction. When the lower end of the picture is reached, thelabels are arrayed in similar manner with a shift of one row towardsleft. In the “arraying at the lower end of a picture”, labels arearrayed side-by-side from the lower left end of the picture in arightward direction. When the rightward end of the picture is reached,the labels are arrayed in similar manner with a shift of one rowupwards. The labels are arrayed in the sequence in which the labels areregistered in a project label list (in the time order of preparation).The labels are arrayed so as not to be overlapped with one another, withthe label size being not changed.

In the “property” of the operation on the labels, the property dialog ofthe label, such as is shown in FIG. 50, is displayed. The propertydisplay contents include “label number”, “number of times ofhysteresis”, “term of validity”, “setting of repetitive labels” and“alarm setting”. In the “label number”, a label number unique in theproject is displayed. This label number is managed by the label softwareof the present embodiment and cannot be changed by the user. The “numberof times of hysteresis” displays the number of times of correction asfrom the time of the label preparation. The “term of validity” includesthe “time of preparation” and “time of deletion”. The “time ofpreparation” displays the label preparation time. This “time ofpreparation” cannot be changed except at the time of preparation of afuture label. The “time of deletion” is valid only when the continuationis checked. The, “setting of repetitive labels” includes such items as“interval and unit of repetition”, “next display start time” and “nextdisplay end time”. The “alarm setting” includes “time of alarm startup”.

In the label software of the present embodiment, the following settingcontents of the “continue/discontinue”, “repetition setting” and “alarmsetting” for the labels can be changed in the label property picture.If, in the item “continue/discontinue”, the setting is for“discontinue”, the label deletion time can be specified. When the timeis the specified time, the label is deleted automatically. If, in theitem “repetition setting”, the “periodic repetitive label” is checked,repetition setting is made. Moreover, in the item “repetition setting”,the interval of repetition, display start time and display end time canbe set. In the item “alarm setting”, the alarm display time is set atthe relative timing relative to the label start time. Meanwhile, thereal alarm time is displayed below the alarm setting.

In the label software of the present embodiment, display/non-display canbe repeated at regular intervals for the same label. For labelrepetition, “periodic repetition label (periodic repetition)” is checkedin the label property picture of FIG. 50 and the repetition interval,repetition display time and non-display time are set. For example, if alabel is to be displayed for five minutes at 12.00 every day, thefollowing setting is used:

repetition: every day

next display start time: YYYY/MM/DD (current date) 12:00:00

next display end time: YYYY/MM/DD (current date) 12:05:00

If, in the label software of the present embodiment, setting is made sothat each frame picture of a moving picture is pasted on each of plurallabels and so that each label will be sequentially displayed at the sameposition for a short time, animation-like display becomes possible.

Moreover, in the label software of the present embodiment, the user maybe apprised of an alarm event before or after start of a specifiedlabel. For making the alarm notice, an alarm is checked on a propertyscreen of the label of FIG. 50 to set the alarm time. If the alarm timeis set in this manner, an alarm dialog, shown in FIG. 59, is displayedon the desk top when the time is the time specified on the alarm. Onthis alarm dialog are displayed the alarm time and the label preparationtime. By acting on this alarm dialog, the user is able to make selectionwhether the alarm is to be turned off or issued once more. If, the item“time-view the label preparation time after closing the dialog” in thedialog of FIG. 59 is checked and the OK button is pushed, the time viewmode is initiated and the operating time is set to the label preparationtime.

Then, as the operation for the label “object import/export”, the labelis able to import and display the text, sound and the picture file. Theoperation on importing is similar to that when adding and correcting anobject. The label object is also able to take out only data as an exportfile. Among the forms of the file which each object is able to importand export, there are “text: text form (extender: .txt.)”, sound; WAVEform (extender:.wav)“ ”, “picture; bit map form (extender:.bmp)”, “GIFform (extender:.gif)” and “JPEG form (extender:.jpg)”. In exporting, anobject for exporting is determined based on the extender of the exportfile.

Among the “label deletion” as an operation on the label, there aredeletion of the present label and deletion of deletion of a futurelabel.

If deletion of the present label is selected, the current time isrecorded as the end time and deleted from the picture. However, thelabel file is not deleted such that the label can be displayed byreversion to the past by the time view mode. If the label is deleted inthe future mode of the time view mode, a dialog as shown in FIG. 60 isdisplayed to permit selection between setting the operating time to theend time or deleting the label at the current time.

If deletion of the future label is selected, the dialog of deletion of afuture label as shown in FIG. 61 is opened to render possible theselection between the setting of the operation time to the end time andthe complete deletion of the file. If the label is completely deleted,the label file and recording are deleted such that these cannot bedisplayed again even in the time view mode.

The past label is already deleted and hence cannot be deleted further.

The “operation of time view” is now explained.

In the time view mode, the above-mentioned time view console TVC isdisplayed. The time operation in the time view mode is done from thistime view console TVC. The transition to the time view mode is performedby displaying the time view console TVC by executing a command from acontext menu of the label software icon IL of the time tray TT or fromthe label menu.

After transition to the time view mode, time increase/decrease can beexecuted by operating the up/down button tub, tdb of the time viewconsole TVC or from the menu. The unit of time change by this timeincrease/decrease is by the setting of the above-mentioned timeincreasing/decreasing unit (time increasing/decreasing step).

With the label software of the present embodiment, the label preparationto the past/past label correction cannot be made. Although the pastlabel cannot be corrected, label movement/label size change can be made.However, this operation is not recorded in the project. Also, directlyafter the end of the operation, such as directly after the end of themouse drag, the label is restored to the original position/originalsize. This operation is performed for transiently changing themovement/size change for viewing the label hidden by superposition.

Moreover, in the label software of the present embodiment, a new labelcan be prepared as a future label distinct from a past label. If afuture label is prepared, and the time is restored to the present, thelabel disappears from the desktop. However, when the time is the timewhen the future label was prepared, the label is again presented on thedesktop. So, the future label can be prepared as a simple reminder. Thefuture label can be corrected in the same way as at the present time.However, the hysteresis of correction is not recorded, in distinctionfrom the case of the current time, such that only the corrected ultimateresults are saved. Thus, should there be made correction for future, theultimate results are used as parameters at the time of labelpreparation.

The end of the time view mode is achieved by pressing the closure buttoncb of the time console TVC or selecting the “close time view console”from the menu.

The on/off of the time view sound, furnished during the time view mode,during transition to the time view mode and on termination of the timeview mode, may be achieved from the menu.

The operation on the “keyboard/mouse” is explained.

With the label software of the present embodiment, a variety ofshortcuts are set as an operation proper to a keyboard.

For example, if the control key and the shift key are pushedsimultaneously, or if the shift key, control key and the tab key arepushed simultaneously, the operation of changing the verticalorientation on the window of the labels displayed on the present pictureis realized. Meanwhile, the operation at this time is changed with thenumber of the presently existing labels. For example, of there is notmore than one label, no operation occurs. However, a pre-set sound isissued to indicate that the operation is invalid. If there are two ormore labels, the control key and the tab key are pushed simultaneouslyto shift the label lying at the most forward position to the mostbackward position. Also, if the shift key, control key and the tab keyare pushed simultaneously, the label at the most backward position isshifted to the most forward position.

For example, if the delete key is pushed, the presently focussed labelis deleted. Before deleting the label, a dialog for inquiring whether ornot the deletion is to be made is displayed on the dialog.

Of an escape key is pushed, the presently focussed label is temporarilyset to the non-displayed position. The label in the non-display positionis again displayed when next the time is changed.

When the control key and the B key are pushed simultaneously, theconsole is closed during the time view mode. Of the control key and theD key are pushed simultaneously, the presently focussed label is againlaid out by default. When the control key and the E key are pushedsimultaneously, the text editing of the presently focussed label isopened. If the control key and the L key are pushed simultaneously, thelink of the presently focussed label is opened. If the control key andthe N key are pushed simultaneously, the text label is prepared. Whenthe control key and the O key are pushed simultaneously, the sound ofthe currently focussed label is stopped. When the control key and the Pkey are pushed simultaneously, the label of the currently focussed labelis reproduced. When the control key and the R key are pushedsimultaneously, the label of the currently focussed label commences tobe recorded. When the control key and the T key are pushedsimultaneously, the time view mode is entered/exited. When the controlkey and the V key are pushed simultaneously, the contents of theclipboard are pasted on the currently focussed label. When the controlkey and the down key/the control key and the up key are pressedsimultaneously, the time in increased/decreased by the time view. Whenthe control key and the left key/the control key and the down key arepressed simultaneously, the time increasing/decreasing steps are varied.When the control key and the home key are pushed simultaneously,reversion is made to the current time by the time view mode.

With the label software of the present embodiment, as the operation onthe mouse, in particular the mouse fitted with the wheel, “operations onthe label”, “operations on the time view console” and “operations on thedesktop of the time view mode” are set.

Among the “operations on the label”, there are such operations as “dragand drop for a label”, “drop to a label from another application”,“right click for a label”, “wheel rotation for a label”, “wheel clickfor a label”, “drag and drop to a label (excluding the link button) fora file icon”, “drag and drop to a label (excluding the link button) fora control key, shift key and a file icon” and “drag and drop on a linkbutton for a file icon”. In the operation of “drag and drop for alabel”, labels are moved. In the operation of “drop to a label fromanother application”, an object is pasted to a label insofar as datarecognized by the present embodiment of the label software is concerned.An error dialog is displayed insofar as data not recognized by thepresent embodiment of the label software is concerned. In the operationof “right click for a label”, the context menu dependent on the clickedobject is displayed. In the operation of “wheel rotation for a label”,the forward/backward relationship of the labels is adjusted. In theoperation of “wheel click for a label”, the time view console isdisplayed to transfer to the time view mode. In the operation of “dragand drop to a label (excluding the link button) for a file icon”, texts,pictures and sound files are inserted as objects. If a file cannot berecognized as an object, an inquiry is made as to whether or not it canbe inserted as a link object for the file. In the operation of, “dragand drop to a label (excluding the link button) for a control key, shiftkey and a file icon” and “drag and drop on a link button for a fileicon”, a path to the dragged and dropped file is inserted as a linkobject. If it is tried to insert a file path as a link object by dragand drop to a site other than the link button LB on the label, an alarmdialog shown in FIG. 62 is displayed. If a button “YES” is pushed whenthe dialog is displayed, the processing is the same as when a file pathis inserted as a link object by drag and drop on the link button LB onthe label.

Among the “operations on the time view console”, there are suchoperations as “right click on the console”, “wheel rotation for theoperating time display portion of the console” and “wheel rotation for astep selecting list box of the console time increase/decrease”. In theoperation of “right click on the console”, the context menu isdisplayed. The operation of “wheel rotation for the operating timedisplay portion of the console” corresponds to time increase/decrease.The operation of “wheel rotation for a step selecting list box of theconsole time increase/decrease” corresponds to change in the timeincreasing/decreasing steps.

In the operations of “operations on the desktop of the time view mode”,there are such operations as “wheel click for the desktop of the timeview mode” and “right click on the desktop of the time view mode”. Theoperation of “wheel click for the desktop of the time view mode”corresponds to change in the time increasing/decreasing steps. In theoperation of “right click on the desktop of the time view mode”, thetime view context menu is displayed.

The “operation on the jog dial” is now explained.

In the label software of the present embodiment, the operation on thejog dial includes such operations as “right/left rotation of the jogdial”, “pushing of the jog dial (with the interval from pushing untilrelease of pushing being not longer than one sec)” and “protractedpushing of the jig dial (with the interval from pushing until release ofpushing being longer than one sec)”. In the label software of thepresent embodiment, the following functions are allocated to theoperations on the jog dial. It is noted that, in the label software ofthe present embodiment, these jog dial operations are not globallypicked at any time, but reaction to the jog dial actuation occurs whenthe label software is focussed.

For example, in a normal mode, the label software of the presentembodiment reacts to the operations of “right/left rotation of the jogdial” and “pushing of the jog dial (with the interval from pushing untilrelease of pushing being not longer than one sec)”. That is, if, in thenormal mode, the operation of “right/left rotation of the jog dial” ismade, the label software of the present embodiment causes theup-and-down relationship of the window of a label currently displayed onthe picture. The operations at this time are changed depending on thenumber of the currently existing labels. If there is not more than onelabel, nothing occurs with the right/left rotation of the jog dial.However, a pre-set sound is issued to indicate that the operation isinvalid. If there are two or more labels, and the operation forrightward rotation of the jog dial is made, the label at the mostforward position is shifted to the most backward position among thelabels. Conversely, when the operation for leftward rotation of the jogdial is made, the label at the most backward position is shifted to themost forward position among the labels. If, during the normal mode, theoperation of “pushing of the jog dial (with the interval from pushinguntil release of pushing being not longer than 1 sec)” is made, thelabel software of the present embodiment displays the time view consoleto transfer to the time view mode.

Also, in the time view mode, the label software of the presentembodiment reacts to all of the operations of “right/left rotation ofthe jog dial”, “pushing of the jog dial (with the interval from pushinguntil release of pushing being not longer than 1 sec)” and “protractedpushing of the jig dial (with the interval from pushing until release ofpushing being longer than 1 sec)”. That is, if, in the time view mode,the operation of “right/left rotation of the jog dial” is made, thelabel software of the present embodiment corresponds to the timeincrease/decrease. For example, if the jog dial makes rightward rotationand leftward rotation, time proceeds in the future and past distentions,respectively. If the operation of, “pushing of the jog dial (with theinterval from pushing until release of pushing being not longer than 1sec)” is performed, the label software of the present embodimentcorresponds to the change in the time increasing/decreasing units (timeincreasing/decreasing steps). For example, the timeincreasing/decreasing units are changed in the sequence of 100 years, 10years, 1 year, 1 month, 1 day, 1 hour, 1 minute, 1 sec, 10 years, 10years, . . . each time the jog dial is pushed. If the jog dial isrotated as the shift key is pushed, the time increasing/decreasingintervals are changed in the reverse sequence to that when only the jogdial is rotated. The time increasing/decreasing intervals selected atthe time of the pushing of the jog dial can be set when setting theenvironment. When the operation of “pushing of the jig dial (with theinterval from pushing until release of pushing being longer than 1 sec)”is done, the label software of the present embodiment closes the timeview console to transfer to the present mode.

In the label software of the present embodiment, the operation thatoccurs on jog dial actuation is displayed on the desktop as the jog dialguide to present to the user the contents of the operationscorresponding to the jog dial actuating state and to the jog dialactuation. That is, in the label software of the present embodiment, thejog dial guides of different contents are presented in the normal modeand in the time view mode since the functions are allocated in thesemodes to the jog dial actuation.

FIG. 63 shows an example of the jog dial guide during the normal modeand that during the time view mode. That is, in the jog dial guideduring the normal mode, shown in FIG. 63, the contents of the functionscorresponding to the “right/left rotation of the jog dial”, “pushing ofthe jog dial (with the interval from pushing until release of pushingbeing not longer than 1 sec)” are displayed as guides. In the jog dialguide during the normal mode, shown in FIG. 63, the contents of thefunctions corresponding to the “right/left rotation of the jog dial”,“pushing of the jog dial (with the interval from pushing until releaseof pushing being not longer than 1 sec)” and “protracted pushing of thejig dial (with the interval from pushing until release of pushing beinglonger than 1 sec)” are displayed as guides.

The setting contents in the label software of the present embodiment arehereinafter explained. In the label software of the present embodiment,“label setting”, “setting of default label layout”, “setting of soundrecording”, “picture setting” and “environment setting” are possible.These setting contents are saved in a registry and used as commonsetting among the entire projects.

As the “label setting”, the label software of the present embodiment isable to set the label default values. In the label setting picture,there are “default background color”, “default font inclusive of textcolor”, “default word-wrapping state”, “display preparation time” and“apply text color only to text”, as shown in FIG. 65. In the “defaultbackground color”, the background color of the newly prepared label isset. In the “default font inclusive of text color”, the font of thenewly prepared label is set. In the “default word-wrapping state”, it isset whether or not the word-wrapping is to be applied to the newlyprepared label. In the “display preparation time”, it is set whether ornot the preparation time is to be displayed on the newly prepared label.In the “apply text color only to text”, it is set whether the backgroundcolor is to be applied to the entire label or only to the text. In thelower part of the label software setting picture, a sample of the labelstate in the current setting is displayed.

In the “default label layout”, default layout in the above-mentionedlayout portion is made.

In the “setting of sound recording”, various parameters for soundrecording are set. The setting contents include such items as “soundsource”, “quantization level”, “sampling frequency” and “maximumrecording time”. With the “sound source”, monaural/stereo setting ispossible, whereas, with the “quantization level”, and “samplingfrequency”, the setting of 8 bits/16 bits and the setting of 11.025 kHz,22.05 kHz and 44.1 kHz are possible, respectively.

In the “picture setting”, the picture during use of the capture pictureretrieving application is set. The setting contents include “operationon pushing the capture retrieving button”, “format of a pictureretrieved from a capture picture retrieving application” and “setting ofJPEG compression”, as shown in FIG. 67. The operation of “operation onpushing the capture retrieving button” includes such items as “retrievepicture in a presently selected label” and “retrieve picture in a newlabel”. In “retrieve picture in a presently selected label”, an inquiryis made whether or not a new label is prepared if no label is selected.In the “retrieve picture in a new label”, a new label is prepared toretrieve the picture in a new label. In the “format of a pictureretrieved from a capture picture retrieving application”, there are suchitems as “bitmap” and “JPEG”. In the “bitmap”, H compression is notapplied so that the picture is saved in its original state. In the“JPEG”, compression is applied, however, the disc capacity can bereduced. In the “JPEG setting”, the compression ratio of the retrievedpicture is set when the “JPEG” is set in the “format of a pictureretrieved from a capture picture retrieving application”. Thecompression ratio ranges between 1/1 to 1/64.

In the “environment setting”, “default command”, “startup” and “timeincreasing/decreasing interval” are set. In the “default command”, “addnew label”, “add new label and record the sound”, “add new label andacquire picture from the capture picture retrieving application” and“enter into time view mode” etc. In the “startup”, it is set whether ornot the registration in the startup is to be made. In the “timeincreasing/decreasing interval”, the time increasing/decreasingintervals (time increasing/decreasing steps) selected on pushing thetime increasing/decreasing step selection menu button sb is set. Thetime increasing/decreasing interval not set here is not unusable and canbe selected by selection from a combo-box or on clicking a date letterstring. The time increasing/decreasing interval checked here are markedwith “*” on the right side of a letter in the time increasing/decreasingstep selection list box ssl as discussed above.

With the label software of the present embodiment, having theabove-mentioned functions, the entire operations on the labels on thedesktop are saved to enable reproduction of label states at an optionaltime point. For saving the label states on the desktop, a method ofsaving the entire information of plural labels at a given time point anda method of saving only the difference of the label information at atime point may be used. The label states may be saved periodically atregular intervals or at time points when changes are made in the labels.For saving the differences in the label information, the operations onthe label, that is the operating hysteresis, are saved, or thedifference of the label information before and after operations on thelabel, that is the variance in the label information, may be saved.

With the label software of the present embodiment, having theabove-mentioned functions, not only the operations on the present label,but also the future operations, may be appointed to enable labels(future labels) to be used as reminders. The operations on the futurelabels are determined when the current time is the time set in thefuture level. Therefore, the hysteresis as to the operations on thefuture labels is not saved but only the information on the lastoperation is saved. Although the future label may also have thehysteresis, plural futures exist in this case. This surpasses the rangeof human understanding. For this reason, the present embodiment does notset the hysteresis for the future labels. For appointing the operationsfor future labels, repetitive operations of the labeldisplay/non-display may be envisaged in addition to the operation suchas simple label preparation.

Moreover, in the label software of the present embodiment, having theabove-mentioned functions, in which the label has the concept of time,it is possible to associate a label with an alarm to ring an alarm whenthe time is the pre-set time. This alarm rings irrespective of thecurrent desktop display time, such that, even when the state of past orfuture label states are displayed, the alarm is rung to avoid the riskof overlooking crucial label information. Meanwhile, an alarm to a labelcan be attached to each label. In distinction from a usual alarm, thepresent alarm can be rung not only before the preparation time but alsoafter label preparation. Moreover, an alarm can be rung even to theselected alarm. For this reason, the alarm can be rung after 1 year sothat an alarm can be rung after lapse of a year from an anniversary.

Referring to FIGS. 69 to 72, the processing flow in the CPU 51 in caseof implementing the above process by a personal computer is explained.

FIG. 69 shows the overall flow of the reproducing processing of thelabel states at an optional past time point, the reproducing processingof the appointment for operations for future labels and alarmprocessing. If the label software is started at step S131, the CPU 51records the processing at step S132 in case some operation or other isperformed on the label. If the alarm setting is made, the alarmprocessing is performed at step S133, whereas, if setting for repetitionis made for a label, the label updating processing is performing at stepS134. The CPU 51 then verifies whether or not each processing has cometo a close. If the result of check is YES, the CPU reverts to step S132and, if otherwise, the CPU moves to step S136. The CPU 51, proceeding tostep S136, performs the end processing of the label software.

FIG. 70 shows a detailed flow of the operational recording processing ofstep S132. If, in FIG. 70, the operating recording processing isstarted, the CPU 51 at step S141 verifies whether or not some operationor other has been done on a label by the user. If the result of check isNO, the recording processing is closed to proceed to step S133 and, ifotherwise, the CPU 51 proceeds to the processing of step S142 to computethe label difference information before and after the processingoperation. The CPU 51 then verifies at step S143 whether the operationon the label is that on the current label (operating hysteresis) or theoperation on the future label (operation appointment). If the processingis verified at this step S143 to be the operation on the current label,the CPU 51 at step S144 adds the current time to the label differenceinformation to save the resulting data. if the operation is found atstep S43 to be that on the future label, the CPU 51 at step. S145 addsthe appointed time to the label difference information to save theresulting data. After the processing of these steps S144 and S145, theCPU 51 terminates the operation recording processing to proceed ti theprocessing of step S133 of FIG. 69.

FIG. 71 shows a detailed flow of alarm processing of step S133 of FIG.69. In FIG. 71, when the alarm processing is started, the CPU 51 at stepS151 verifies whether or not an alarm has been set in the label. If theresult of check at this step S51 is NO, the alarm processing isterminated to proceed to the processing of step S134 of FIG. 69. If theresult of check is YES, the CPU 51 checks whether or not the currenttime is past (or is) the alarm setting time. If the CPU verifies thatthe current time is past the alarm setting time, it proceeds to stepS153 and, if otherwise, it proceeds to step S156. At step S153, the CPU51 rings an alarm and, at step S154, it verifies whether or not theobject label corresponding to the alarm is to be displayed. If theresult of check at step S154 is NO, the CPU 51 proceeds to theprocessing of step S156 and, if otherwise, it proceeds to the processingat step S255. At step S155, the CPU 51 sets the display time to the timewhen the object label is saved and proceeds to step S156. At step S156,the CPU 51 checks whether or not the label alarm processing has come toa close. If the result of check is NO, the CPU reverts to step S151 and,if otherwise, the CPU terminates the alarm processing to proceed to theprocessing of step S134 of FIG. 69.

FIG. 72 shows the flow of detailed processing of step S134 of FIG. 69.In this figure, when the label updating processing is started, the CPU51 at step S161 verifies whether or not there is any label set forrepetition. If the result of check is NO, the CPU 51 proceeds to stepS163 and, if otherwise, to step S162. At step S162, the CPU 51 executeslabel repetition processing. The CPU 51 then proceeds to step S163. Atstep S63, the CPU 51 verifies whether or not the current state is beingdisplayed. If the result of check at step S63 is NO, that is the currentstate is the past or future mode, the CPU proceeds to step S165 and, ifotherwise, to step S164. At step S164, the CPU 51 sets the display timeto the current time and then proceeds to step S166. At step S165 Aftersetting the display time to the current state, the CPU 51 proceeds tostep S166. At step S165, the CPU51 sets the display time to the userspecified time, before it proceeds to step S166. At step S166, the CPU51 displays the state of the label of the display time as set (present,past or future mode). The CPU 51 then terminates the label updatingprocessing to proceed to the processing of step S135.

The label software of the present embodiment, having the above-mentionedfunctions, realizes not only definite information, such as text orpicture, to the label, but also the link function of indirectly pastingthe entire information. Thus, in the label software of the presentembodiment, which realizes the link function, there is no necessity ofdisplaying the entire information in a label of a definite size, thusenabling effective utilization of the label area. That is, in the caseof a label having no link function, contrary to the present embodiment,the entire information needs to be retrieved at a time point the objectis pasted to the label. Meanwhile, in the label software of the presentembodiment, the entire link information can be displayed in a label. Bythis link function, the personal computer in the started state of thelabel software of the present embodiment is able to display not only theinformation in a local machine but also the information on the networkon the label. Since the information on the network can be linked and seton a label, the personal computer of the present embodiment is able todisplay the link contents only when the user requests execution, suchthat there is no necessity of the personal computer being perpetuallylinked to the network.

The processing flow in the CPU 51 in case of realizing the link functionon the label by the label software of the present embodiment is shown inFIGS. 73 to 75.

FIG. 73 shows the overall processing flow in case of indirectly pastingthe entire information on the label by the link. When the label softwareis started at step S171, the CPU 51 at step S172 verifies whether or notthe link has been corrected. If the result of check at step S172 is NO,the CPU 51 proceeds to step S174 and, if otherwise, to step S173. Atstep S173, the CPU 51 executes link editing processing. The CPU 51 thenverifies whether or not the link is to be executed. If the result ofcheck at step S174 is NO, the CPU 51 proceeds to step S176 and, ifotherwise, to step S175. At step S175, the CPU 51 performs the linkexecution processing. The CPU 51 then checks at step S176 whether or notthe processing has come to a close. If the result of check at step S176is NO, the CPU 51 reverts to step S172 and, if otherwise, to step S177,where the CPU 51 executes label software terminating processing.

FIG. 74 shows the detailed processing flow of step S173. In FIG. 74,when the link editing processing is started, the CPU 51 checks at stepS181 whether or not the link editing is done by drag and drop by e.g., amouse. If the result of check at step S181 is YES, the CPU 51 proceedsto step S183 and, if otherwise, to step S182. At step S183, the CPU 51saves the dragged and dropped file path and URL as link and thenterminates the link editing processing to proceed to the processing atstep S174 of FIG. 73. At step S182, the CPU 51 displays the link editingdialog shown in FIG. 53 before proceeding to step S184. At step s184,the CPU 51 verifies whether or not, in the above-mentioned link editingdialog, the file path of the link destination or URL has been entered orthe link reference command has been issued. If it is verified that thefile path of the link destination or the URL has been entered, the CPU51 proceeds to step S187. If it is verified that the link referencecommand has been issued, the CPU 51 proceeds to step S185. At step S187,the CPU 51 saves the input file path or the URL as the link destinationto then terminate the link editing processing to proceed to step S174 ofFIG. 73. At step S185, the CPU 51 displays the link reference dialogbefore proceeding to step S186, where the CPU 51 saves the referencedfile path or URL as the link destination. The CPU 51 then terminates thelink editing processing to proceed to step S174 of FIG. 73.

FIG. 75 shows the detailed processing flow of the processing at stepS175 of FIG. 73. In FIG. 75, when the link editing processing isstarted, the CPU 51 at step S191 checks whether or not the saved linkinformation is URL. If the result of check at step S191 is YES, the CPU51 proceeds to step S193 and, if otherwise, to step S192. At step S193,the CPU 51 opens the saved link information as URL and subsequentlyterminates the link executing processing to proceed to the processing atstep S176 of FIG. 73. At step S192, the CPU 51 checks whether or not thesaved link information is a path to an execution file. If the result ofcheck at step S192 is YES, the CPU 51 proceeds to step S195 and, ifotherwise, to step S194. At step S195, the CPU 51 executes the savedlink as an executing file to then terminate the link editing processingto proceed to step S176 of FIG. 73. At step S194, the CPU 51 opens thesaved link as a document file to then terminate the link editingprocessing to proceed to step S176 of FIG. 73.

With the label software of the present embodiment, having theabove-mentioned function, the time label for the purposes ofpresent/past/future can be easily displayed on the desktop.

For moving the label time on the desktop, it may be envisaged toadvance/retract the time by a pre-set interval by the user executing asole command. This enables the information one day before or after to beretrieved easily.

For moving the label time on the desk top, it may be envisaged toadvance/retract the time up to a time point of change of the informationby a user executing a command. The time interval at this time is notconstant and determined by the change point of the label information sothat the movement time is variable. This enables the label informationswitching time point to be retrieved easily.

For moving the label time on the desktop, it may be envisaged to varythe time advancing/retracting manner in an accelerated manner by theuser executing the consecutive commands. This enables movement to thetarget time easily and speedily.

The processing flow by\y the CPU 51 in implementing the label timemovement function on the desktop by a personal computer by the labelsoftware of the present embodiment is shown in FIGS. 76 to 78.

FIG. 76 shows the overall processing flow enabling movement to anoptional present/past/future time. When the label software is started atstep S201, the CPU 51 at step S202 verifies whether or not the timemovement unit, that it the above-mentioned time increasing/decreasingintervals (time increasing/decreasing steps) are to be changed. If theresult of check at step S201 is NO, the CPU 51 proceeds to step S204and, if otherwise, to step S203. At step S203, the CPU 51 changes thetime movement unit, that it the above-mentioned timeincreasing/decreasing intervals (time increasing/decreasing steps). TheCPU 51 at step S204 verifies whether or not the label time movement onthe desktop has been commanded. If the result of check at step S204 isYES, the CPU 51 proceeds to step S206 and, if otherwise, to step S205.At step S205, the CPU 51 performs the time movement processing, that ismovement to a desktop picture in the past or future mode. After the timemovement processing at step S205, the CPU 51 at step S206 updates thedisplay at the set time to proceed to step S207. The CPU 51 at step S207verifies whether or not the processing has come to a close. If theresult of check at step S207 is NO, the CPU 51 reverts to step S202 and,if otherwise, to step S208. At this step S208, the CPU 51 executes theend processing for the label software.

FIG. 77 shows the detailed processing flow of the processing at stepS203 of FIG. 76. In FIG. 77, when the processing for changing the timemovement unit (change of the time increasing/decreasing interval) isstarted, the CPU 51 at step S211 verifies whether or not the informationchange point unit has been set as the movement unit. If the result ofcheck at step S211 is YES, the CPU 51 proceeds to step S213 and, ifotherwise, to step S212. At step S213, the CPU 51 sets the informationchange point as the time movement intervals (time increasing/decreasingintervals or time increasing/decreasing steps) to terminate the timemovement unit change processing to proceed to step S204 of FIG. 76. Atstep S212, the CPU 51 sets the specified unit (100 years, 10 years, 1year, 1 month. 1 day, . . . to terminate the time movement unit changeprocessing to proceed to the processing at step S204 of FIG. 76.

FIG. 78 shows the detailed processing flow of the processing at stepS205 of FIG. 76. In FIG. 78, when the time movement processing isstarted, the CPU 51 at step S221 verifies whether or not the timemovement is directly commanded by the above-mentioned operation timedisplay unit oti. If the result of check at step S221 is YES, the CPU 51proceeds to step S223 and, if otherwise, to step S222. At step S223, theCPU 51 sets the above-mentioned directly commanded time as the timemovement interval (time increasing/decreasing interval or timeincreasing/decreasing step) before terminating the time movementprocessing to proceed to step S206 of FIG. 76. At step S222, the CPU 51checks whether or not the information change point interval has been setas the time movement interval (time increasing/decreasing interval ortime increasing/decreasing step). If the result of check at step S222 isNO, the CPU 51 proceeds to step S225 and, if otherwise, to step S224. Atstep S225, the CPU 51 advances (or retracts) the time with the so-settime interval to then terminate the time movement processing to proceedto the processing of step S206. At step S224, the CPU 51 retrieves thenext or previous change point. The CPU 51 at step S226 verifies whetheror not the next or previous change point has been found. If the resultof check at step S226 is NO, the CPU 51 terminates the time movementprocessing to proceed to step S206 of FIG. 76 and, if otherwise, to stepS227. At this step S227, the CPU 51 terminates the time movementprocessing to proceed to step S206 of FIG. 76. If the result of check atstep S226 is YES, the CPU 51 proceeds to step S227, where the CPU 51sets the time as found by retrieval as the movement time to thenterminate the time movement processing to proceed to the processing ofstep S206 of FIG. 76.

With the label software of the present embodiment, having theabove-described functions, a jog dial can be used as a user interfacefor label time movement on the desktop. With the use of the jog dial,the operation of advancing/retracting the time is realized by theoperation of rotating the jog dial in the rightward/leftward directionto provide for smooth time movement processing operations.

With the label software of the present embodiment, having theabove-described functions, the jog dial pushing operation can beallocated to the alteration of the advancing/retracting time interval.Therefore, the entire operations of changing the label time can berealized solely by jog dial operation, as a result of which the timechange can be realized without using routine keyboard or mouse.

With the label software of the present embodiment, having theabove-described functions, the jog dial pushing operation can beallocated not only to making change in the regular timeincreasing/decreasing interval in label display but also to making theabove-mentioned change point movement of the label information. Theresult is that the time movement with the attention directed only to theinformation change point can be realized solely by actuation on the jogdial.

Moreover, with the label software of the present embodiment, having theabove-described functions, the amount of label time movement can bevaried depending on the rotating speed of the jog dial to render moreprompt retrieval of discrete time points.

In addition, with the label software of the present embodiment, havingthe above-described functions, the jog dial pushing is used as a triggerfor the time movement mode and the subsequent jog dial rotation/pushingoperation is allocated to the above-mentioned time movement operation.By dividing the function between the short jog dial pushing and the longjog dial pushing, the entire operation of entering into the timemovement mode/exiting the time movement mode can be realized solely bythe jog dial. In this manner, the information scattered in thepresent/past/future can be browsed solely by the jog dial. It is notedthat data correction is in need of input devices, such as a keyboard ora mouse.

Furthermore, with label software of the present embodiment, the timemovement processing is facilitated by employing a shift key or a controlkey in combination with the jog dial rotating/pushing operation toexecute counter-functions. If, for example, the unit of the timeincreasing/decreasing interval are changed from smaller to largervalues, by pushing the jog dial, and the shift key or the control key isused in combination, the unit of the time increasing/decreasing intervalis changed in an opposite direction to the case of using only the jogdial to facilitate selection of the unit of the timeincreasing/decreasing interval.

The processing flow in the CPU 51 in case the time movement topresent/past/future is to be realized by the jog dial operation is shownin FIGS. 79 to 82.

FIG. 79 shows the overall flow in case the time movement topresent/past/future is to be realized by the jog dial operation. If, atstep S231, the label software is started, the CPU 51 at step S232verifies whether or not the jog dial has been thrust. If the result ofcheck at step S232 is NO, the CPU 51 proceeds to step S234 and, ifotherwise, to step S233. At step S233, the CPU 51 browses theinformation by rotation of the jog dial. At step S234, the CPU 51verifies whether or not the processing has come to a close. If theresult of check at step S234 is NO, the CPU 51 reverts to step S232 and,if otherwise, the CPU 51 proceeds to step S235, where the label softwareproceeds to terminate the label software.

FIG. 80 shows the detailed processing flow performed at step S233 ofFIG. 79. If, in FIG. 80, the browsing processing by the jog dial isstarted, the CPU 51 at step S242 verifies whether or not the jog dialhas been pushed for long time, with the interval since pushing untilrelease of the jog dial being not shorter than 1 sec. If the result ofcheck at step S242 is YES, the CPU 51 terminates the browsing processingto proceed to step S234 of FIG. 79 and, if otherwise, the CPU 51proceeds to step S243. At this step S243, the CPU 51 verifies whether ornot the jog dial has been pushed, with the interval since pushing untilrelease of the jog dial being not longer than 1 sec. If the result ofcheck at step S243 is NO, the CPU 51 proceeds to step S245 and, ifotherwise, to step S244, where the CPU 51 changes the timeincreasing/decreasing unit corresponding to the pushing of the jog dial.When the CPU 51 proceeds to step S245, the CPU 51 verifies whether ornot rotation of the jog dial has been made. If the result of check atstep S245 is NO, the CPU 51 reverts to step S242 and, if the result ofcheck at step S245 is YES, the CPU 51 proceeds to step S246 where theCPU 51 executes time movement processing corresponding to the rotationof the jog dial. At step S247, the CPU 51 changes the display with theset time to then revert to step S242. At step S248, the CPU 51terminates the browsing by the jog dial to proceed to the processing ofstep S234 of FIG. 79.

FIG. 81 shows the detailed processing flow of step S244 of FIG. 80. InFIG. 81, the CPU 51 verifies at step S251 whether or not the shift keyhas been thrust. If the result of check at step S251 is YES, the CPU 51proceeds to step S253 and, if otherwise, to step S252. At this stepS252, the CPU 51 checks whether or not the current time interval unit(time increasing/decreasing unit or step) is the minimum unit. If theresult of check at step S252 is YES, the CPU 51 proceeds to step S255and, if otherwise, to step S254. At step S253, the CPU 51 checks whetheror not the current time interval unit (time increasing/decreasing unitor step) is the maximum unit. If the result of check at step S253 isYES, the CPU 51 proceeds to step S255 and, if otherwise, to step S256.At step S254, the CPU 51 sets the next unit on the operation timedisplay unit oti as the time movement interval (timeincreasing/decreasing unit or time increasing/decreasing step). The CPU51 then terminates the movement unit changing operation to proceed tostep S245 of FIG. 80. At step S255, the CPU 51 sets the above-mentionedinformation change point as the time movement interval (timeincreasing/decreasing unit or time increasing/decreasing step). The CPU51 then terminates the time movement unit changing processing to proceedto step S245 of FIG. 80. At step S256, the CPU 51 sets the previous unitof the operation time display unit oti as the time movement interval(time increasing/decreasing unit or time increasing/decreasing step).The CPU then terminates the time movement unit changing processing toproceed to step S245 of FIG. 80.

FIG. 82 shows the detailed processing flow of step S246 of FIG. 80. InFIG. 82, the CPU 51 verifies at step S261 whether or not continuous jogdial rotating operation has been made. If the result of check at stepS261 is YES, the CPU 51 proceeds to step S263 and, if otherwise, to stepS262. At step S263, the CPU 51 sets to perform timeincreasing/decreasing at an accelerated pace, that is to accelerate timeincreasing/decreasing, in agreement woththe continuous rotatingprocessing of the jog dial, before proceeding to step S262. At stepS262, the CPU 51 verifies whether or not the information changing pointinterval has been set as the time movement interval (timeincreasing/decreasing unit or time increasing/decreasing step). If theresult of check at step S262 is YES, the CPU 51 proceeds to step S264and, if otherwise, to step S265. At step S264, the CPU 51 retrieves thenext (or previous) information changing point, as it takes into accountthe results of check at step S261, if the acceleration setting is madeat step S263. The CPU 51 then proceeds to step S267. At step S265, theCPU 51 advances the time with the time interval as set, as it takes intoaccount the results of check at step S261, if the acceleration settingis made at step S263. The CPU 51 then terminates the time movementprocessing to proceed to step S267 of FIG. 80. At this step S267, theCPU 51 verifies whether or not the next (or previous) informationchanging point has been found. If the result of check at step S267 isYES, the CPU 51 proceeds to step S268 and, if otherwise, to step S269.At this step S269, the CPU 51 sets the time of the last (or first)change point as the movement time to then terminate the time movementprocessing to proceed to the processing of step S247 of FIG. 80.

In the label software of the present embodiment, having theabove-described functions, the time movement processing by the jog dialas discussed above can be reflected, as a jog dial guide, on thepicture. Moreover, with the label software of the present embodiment, aportion of the picture (rotation animation unit ra of the time viewconsole) can be displayed as the rotation animation, in agreement withthe jog dial rotating operation, while the difference in the jog dialrotating operation can be represented by changing the direction of therotation animation.

Moreover, in the label software of the present embodiment, the currenttime is represented by numerical figures on the operation time displayunit oti, whilst the western calendar graph is represented on theChristian era gauge unit cg, so that these representations can be madein real-time. In addition, time changes is rendered more definite byscrolling the western calendar graph. Meanwhile, in the western calendargraph, the current time and the time of the label displayed on thedesktop are indicated by different lines, such as with different colors,to enable the relationship between the current time and the display timeto be recognized more easily.

Furthermore, with the label software of the present embodiment, thedesktop background picture is varied with the present/past/future torender the currently feasible operations definite. For example, thesituation in which correction is not possible in the past, only thelabel operation appointment is possible for future and all operationsare feasible at present is clarified for the user by changing thedesktop background picture.

FIGS. 84 and 85 shows the processing flow in the CPU 51 in which thedisplaying function of the jog dial guide or the western calendar graphis realized with the personal computer.

FIG. 83 shows the overall flow when the jog dial operation is used as auser interface for time movement. First, when the label software isstarted at step S271, the CPU 51 at step S272 verifies whether or notthe jog dial has been rotated. If the result of check at step S272 isNO, the CPU 51 proceeds to step S274 and, if otherwise, to step S273. Atthis step S273, the CPU 51 browses the information in keeping with therotation of the jog dial. At step S274, the CPU 51 verifies whether ornot the processing has come to a close. If the result of check at stepS274 is NO, the CPU 51 reverts to step S272 and, if otherwise, to stepS275, where the CPU 51 terminates the label software.

FIG. 84 shows the detailed processing flow at step S273 of FIG. 83. InFIG. 84, when the browsing processing in agreement with the jog dialactuation at step S281, the CPU 51 at step S282 whether or not the jogdial has been rotated. If the result of check at step S282 is YES, theCPU 51 proceeds to step S283 and, if otherwise, to step S288. At stepS283, the CPU 51 displays the rotation animation in agreement with thedirection of jog dial rotation. At step S284, the CPU 51 performs timemovement in agreement with the direction and the amount of jog dialrotation. In addition, the CPU 51 at step S285 displays the time by thetime movement processing and updates the western calendar graph. The CPU51 then at step S286 checks whether or not the past/present/future statehas been changed. If the result of check at step S286 is NO, the CPU 51proceeds to step S288 and, if otherwise, to step S287, where the CPU 51updates the background picture of the desktop picture depending on itspast/present/future state to then proceed to step S288. At this stepS288, the CPU 51 checks whether or not the browsing processing inkeeping with the jog dial actuation is to be terminated. If theprocessing is verified not to be terminated, the CPU 51 reverts to stepS282 and, if otherwise, the CPU 51 performs the browser terminatingprocessing at step S289 to then proceed to the processing of step S274of FIG. 83.

In the label software of the present embodiment, having theabove-mentioned functions, the state whether or not the information ofrespective labels can be changed during information browsing in thepast/present/future is displayed on a label to realize the function ofenabling the label state to be presented to the user. For displaying thelabel state, an icon may be shown on a portion of the label.Alternatively, labels may also be fringed such as by changing the fringecolor. If the number of label states is increased from two, namely thecorrectable state and the correction inhibiting state, for clarifyingthe reason for correction inhibition, the user is able to recognize thestate more clearly.

FIGS. 85 to 87 show processing flow in the CPU 51 in case the labelstate presenting function is to be realized by a personal computer usingthe label software of the present embodiment.

FIG. 85 shows the overall flow of the function presenting the labelstate to the user. When the label software is started at step S291, theCPU 51 at step S292 verifies whether or not the time movement processinghas been made by rotation of the jog dial, keyboard actuation or theup/down button tub, tdb. If the result of check at step S292 is YES, theCPU 51 proceeds to step S29, where the CPU 51 performs an informationbrowsing operation in keeping with the time movement processing. At stepS294, the CPU 51 verifies whether or not the processing has come to aclose. If the result of check at step S294 is NO, the CPU 51 reverts tostep S292 and, if otherwise, the CPU 51 proceeds to step S295, where theCPU 51 terminates the label software.

FIG. 86 shows the detailed processing flow at step S293 of FIG. 85. InFIG. 86, if the browsing by the time movement processing at step S301 isstarted, the CPU 51 at step S301 verifies whether or not the displaytime has been changed by the time movement processing. If the result ofcheck at step S301 is YES, the CPU 51 proceeds to step S303 and, ifotherwise, to step S307. At step S303, the CPU 51 performs time movementprocessing consistent with the time movement processing. At step S304,the CPU 51 updates the label information. The CPU 51 then verifies atstep S305 whether or not the past/present/future state has been changed.If the result of check at step S305 is NO, the CPU 51 proceeds to stepS307 and, if otherwise, to step S306. At this step S306, the CPU 51performs the processing for updating of the label editable state, suchas changing the fringe color, depending on its past/present/futurestate, before proceeding to step S307. At this step S307, the CPU 51checks whether or not the browsing is to be terminated. If the result ofcheck at step S307 is NO, the CPU 51 reverts to step S302 and, ifotherwise, the CPU 51 proceeds to the processing of step S294.

FIG. 87 shows the detailed processing flow at step S306 of FIG. 86, inwhich, when the label state updating processing is started at step S311,the CPU 51 at step S312 verifies whether or not the label has beendisplayed. If the result of check at step S312 is YES, the CPU 51proceeds to step S313 and, if otherwise, to step S318. At step S313, theCPU 51 verifies whether the display time is past, present or future. Ifthe CPU 51 verifies that the display time is past, present or future,the CPU 51 proceeds to steps S315, 314 or 317, respectively. If the CPU51 has verified at step S313 that the display time is future, the CPU 51at step S314 verifies whether or not the label is a future label. If theresult of check at step S314 is YES, the CPU 51 proceeds to step S317and, if otherwise, to step S316. At step S315, the CPU 51 sets the labelstate to uneditable (past label) before proceeding to step S318. At stepS316, the CPU 51 sets the label state to uneditable (present label)before proceeding to step S318. At step S317, the CPU 51 sets the labelstate to editable (present or future label) before proceeding to stepS318. At step S318, the CPU 51 checks whether or not the updatingprocessing of the entire labels has come to a close. If the result ofcheck at step S318 is NO, the CPU 51 reverts to step S312 and, ifotherwise, to step S319. At this step S319, the CPU 51 terminates thelabel state updating before proceeding to step S307 of FIG. 86.

In the label software of the present embodiment, a shortcut button(present button bb) for returning to the current time is provided in thetime view console TVC to render it possible to revert to the presenttime even during browsing the past or the future.

FIGS. 88 and 89 show the processing flow in the CPU 51 in case ofrealizing the function of the shortcut button with the personal computerby the label software of the present embodiment.

FIG. 88 shows the overall flow when reversion is to be made instantly bythe present button bb of the time view console TVC. If, at step S321,the label software is started, the CPU 51 verifies whether or not theprocessing is the browsing is started. If the result of check at stepS321 is YES, the CPU 51 proceeds to step S323 and, if otherwise, to stepS324. At step S323, the CPU 51 starts browsing the information beforeproceeding to step S324. At this step S324, the CPU 51 checks whether ornot the processing has come to a close. If the result of check at stepS324 is NO, the CPU 51 reverts to step S322 and, if otherwise, to stepS325, where the CPU 51 performs the label software terminatingprocessing.

FIG. 89 shows the detailed processing flow at step S323 of FIG. 88. InFIG. 89, when the browsing is started at step S332, the CPU 51 verifieswhether or not the display time has been changed. If the result of checkat step S332 is YES, the CPU 51 proceeds to step S333 and, if otherwise,to step S334. At step S333, the CPU 51 performs time movement processingconsistent with the time movement operation. At step S334, it isverified whether or not the present button bb has been pushed. If theresult of check at step S334 is YES, the CPU 51 proceeds to step S335and, if otherwise, to step S336. At step S335, the CPU 51 sets thedisplay time to present to then proceed to step S336. At this step S336,the CPU 51 verifies whether or not the browsing is terminated. If theresult of check at step S336 is NO, the CPU 51 reverts to step S332 and,if otherwise, the CPU 51 at step S337 performs the browsing terminatingprocessing to then proceed to step S324 of FIG. 88.

In the label software of the present embodiment, the design of the iconIL of the label software on the task tray TT is made different in thepresent, past and future modes, and in the all hide states in thepresent mode, so that a selectable menu will be predicted even if thecontext menu is not displayed. Meanwhile, this method is useful not onlyin an application with time shift processing but also in any applicationwhere there is no main window and where the menu is allocated to thetask tray icon. In an application where there is a main window, it is afrequent occurrence that the state can be displayed in the main windowbut the task tray icon is always apparent. Therefore, menu items can bepredicted even if the main window is minimized in size, without thenecessity of resetting the main window to its original size.

The processing flow in which the function of differentiating the designof the label software icon IL on the task tray TT is realized by thepersonal computer is shown in FIGS. 90 to 92.

FIG. 90 shows the overall flow when the design of the label softwareicon IL on the task tray TT is made to differ in the present, past andfuture modes and in the all hide mode in the present mode. First, whenthe label software is started at step S341, the CPU 51 checks whether ornot the entire label is in the non-displaying mode. If the result ofcheck at step S341 is YES, the CPU 51 proceeds to step S343 and, ifotherwise, to step S344. At step S343, the CPU 51 sets a non-displayingicon on the task tray TT to then proceed to step S345. At step S344, theCPU 51 sets a usual icon on the task tray TT to then proceed to stepS345. At this step S345, the CPU 51 verifies whether or not theoperation is browsing start. If the result of check at step S345 is YES,the CPU 51 proceeds to step S346 and, if otherwise, to step S347. Atstep S346, the CPU 51 starts browsing the information to then proceed tostep S347. At this step S347, the CPU 51 checks whether or not theprocessing has come to a close. If the result of check at step S347 isNO, the CPU 51 reverts to S342 and, if otherwise, the CPU 51 proceeds tostep S348, where the CPU 51 performs the label software terminatingprocessing.

FIG. 91 shows the detailed processing flow at step S346 of FIG. 90. If,in FIG. 91, the browsing processing is started at step S351, the CPU 51at step S352 checks whether or not the display time has been changed. Ifthe result of check at step S352 is YES, the CPU 51 proceeds to stepS353 and, if otherwise, to step S357. At step S353, the CPU 51 performstime movement processing consistent with the time movement operation. Atstep S354, the CPU 51 updates the label information to then proceed tostep S355. At this step S355, the CPU 51 checks whether or not thepast/present/future state has been changed. If the result of check atstep S355 is YES, the CPU 51 proceeds to step S356 and, if otherwise, tostep S357. At step S356, the CPU 51 updates the task tray icon beforeproceeding to step S357. At step S357, the CPU 51 checks whether or notthe browsing is to be terminated. If the result of check at step S357 isNO, the CPU 51 reverts to step S352, in which case the CPU 51 performsbrowsing end processing to then proceed to step S374 of FIG. 90.

FIG. 92 shows the detailed processing at step S356 of FIG. 91. In FIG.92, when the icon updating processing is started at step S361, the CPU51 verifies whether the display time is past, present or future. If theCPU 51 verifies that the display time is past, present or future, theCPU 51 proceeds to steps S363, 364 or 365, respectively. At step S363,the CPU 51 sets a past icon, shown in FIG. 43 b, in the label softwareicon IL on the task tray TT, before proceeding to step S366. At stepS364, the CPU 51 sets the present icon, shown in FIG. 43 a, on the labelsoftware icon IL on the task tray TT, before proceeding to step S366.S366. At step S365, the CPU 51 sets the future icon, shown in FIG. 43 c,on the label software icon IL on the task tray TT, before proceeding tostep S366. At this step S366, the CPU 51 terminates the icon updatingprocessing before proceeding to step S357 of FIG. 91.

A medium used for installing the program used for implementing theabove-described sequence of operations to enable execution by thecomputer may comprise not only package mediums, such as floppy discs,CD-ROMs or DVDs, but also semiconductor memories or magnetic discs inwhich the program is stored transiently or permanently. The medium mayalso be implemented by wired or radio communication mediums, such aslocal area network or Internet or digital satellite broadcasting, or avariety of communication interfaces, such as routers or modems fortransferring or receiving a program furnished over these communicationmediums. The medium in the present invention should be interpretedbroadly as meaning all of these mediums.

What is claimed:
 1. A method of processing information, comprising:pasting objects having different attributes onto a pre-set processingunit displayed on a display of an information processing apparatus,wherein the objects include at least one of audio data and video dataand the pre-set processing unit includes a button used to controlreproduction of the at least one of the audio data and video data;storing the pre-set processing unit, position information associatedwith the pre-set processing unit and time information associated withthe pre-set processing unit; regenerating a state of the pre-setprocessing unit associated with a desired date and time based on thetime information and the position information; restoring to the currenttime from the time corresponding to the regenerated state of saidpre-set processing unit; and setting a color of the pre-set processingunit to a first color when the pre-set processing unit is a past pre-setprocessing unit that can not be corrected regardless of whether thepre-set processing unit is being viewed in a past, present or futuremode, and a second color when the pre-set processing unit is a future orpresent pre-set processing unit that is not currently correctable butmay be made correctable by viewing the pre-set processing unit in one ofthe present or future modes.
 2. The method of claim 1, wherein theobjects further include text, and the pre-set processing unit is a tagsheet displayed on a display device.
 3. The method of claim 1, whereinthe time information associated with the pre-set processing unit is atime in the future from the current time, and the regenerating includesnot displaying the pre-set processing unit until the desired date andtime correspond to the time in the future from the current time.
 4. Anon-transitory computer-readable recording medium including computerprogram instructions which, when executed by a computer, cause thecomputer to execute a method of information processing, comprising:pasting objects having different attributes onto a pre-set processingunit displayed on a display of the computer, wherein the objects includeat least one of audio data and video data and the pre-set processingunit includes a button used to control reproduction of the at least oneof the audio data and video data; storing the pre-set processing unit,position information associated with the pre-set processing unit andtime information associated with the pre-set processing unit;regenerating a state of the pre-set processing unit associated with adesired date and time based on the time information and the positioninformation; restoring to the current time from the time correspondingto the regenerated state of said pre-set processing unit; and setting acolor of the pre-set processing unit to a first color when the pre-setprocessing unit is a past pre-set processing unit that can not becorrected regardless of whether the pre-set processing unit is beingviewed in a past, present or future mode, and a second color when thepre-set processing unit is a future or present pre-set processing unitthat is not currently correctable but may be made correctable by viewingthe pre-set processing unit in one of the present or future modes. 5.The non-transitory computer-readable medium of claim 4, wherein theobjects further include text, and the pre-set processing unit is a tagsheet displayed on a display of the computer.
 6. The non-transitorycomputer-readable medium of claim 4, wherein the time informationassociated with the pre-set processing unit is a time in the future fromthe current time, and the regenerating includes not displaying thepre-set processing unit until the desired date and time correspond tothe time in the future from the current time.
 7. An informationprocessing apparatus, comprising: a user interface configured to receivean input pasting objects having different attributes onto a pre-setprocessing unit displayed on a display of the information processingapparatus, wherein the objects include at least one of audio data andvideo data and the pre-set processing unit includes a button used tocontrol reproduction of the at least one of the audio data and videodata; a memory configured to store the pre-set processing unit, positioninformation associated with the pre-set processing unit and timeinformation associated with the pre-set processing unit; a processorconfigured to regenerate a state of the pre-set processing unitassociated with a desired date and time based on the time informationand the position information, restore to the current time from the timecorresponding to the regenerated state of said pre-set processing unit,and set a color of the pre-set processing unit to a first color when thepre-set processing unit is a past pre-set processing unit that can notbe corrected regardless of whether the pre-set processing unit is beingviewed in a past, present or future mode, and to a second color when thepre-set processing unit is a future or present pre-set processing unitthat is not currently correctable but may be made correctable by viewingthe pre-set processing unit in one of the present or future modes. 8.The information processing apparatus of claim 7, wherein the objectsfurther include text, and the pre-set processing unit is a tag sheetdisplayed on a display of the information processing apparatus.
 9. Theapparatus of claim 7, wherein the time information associated with thepre-set processing unit is a time in the future from the current time,and the means for regenerating does not display the pre-set processingunit until the desired date and time correspond to the time in thefuture from the current time.
 10. The information processing apparatusof claim 7, wherein the time information associated with the pre-setprocessing unit is a time in the future from the current time, and theprocessor does not display the pre-set processing unit until the desireddate and time correspond to the time in the future from the currenttime.
 11. The apparatus of claim 7, wherein the button is a play/pausebutton used to command a playback start and a pause of the at least oneof the audio and video data.
 12. The apparatus of claim 7, wherein thebutton is a stop button used to command a stopping of reproduction ofthe at least one of the audio and video data.
 13. The apparatus of claim7, wherein the pre-set processing unit further includes a link buttonused to command an opening of a file or link destination associated withthe pre-set processing unit.
 14. The apparatus of claim 7, wherein thepre-set processing unit further includes a menu button used to command adisplaying of a menu of operations relevant to the pre-set processingunit.
 15. The apparatus of claim 7, wherein the at least one of audiodata and video data pasted on the pre-set processing unit as an objectis captured via a copy or clip operation from another window on adisplay of the information processing apparatus, which is different fromthe pre-set processing unit, and is pasted onto to the pre-setprocessing unit.